-- Logs begin at Wed 2022-09-07 12:21:02 UTC, end at Wed 2022-09-07 13:45:29 UTC. -- Sep 07 13:05:53.881905 dv-cinder-804035-50-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 13:05:53.896018 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 13:05:53 2022] *** Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: nodename: dv-cinder-804035-50-iscsi Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: machine: x86_64 Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: clock source: unix Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: pcre jit disabled Sep 07 13:05:53.899277 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: detected number of CPU cores: 4 Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: current working directory: / Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: detected binary path: /usr/bin/uwsgi-core Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: your processes number limit is 47680 Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: your memory page size is 4096 bytes Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: detected max file descriptor number: 2048 Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: lock engine: pthread robust mutexes Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: thunder lock: enabled Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 13:05:53.900138 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 13:05:53.968556 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: Python main interpreter initialized at 0x557b0859e9c0 Sep 07 13:05:53.968556 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: python threads support enabled Sep 07 13:05:53.968556 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: your server socket listen backlog is limited to 100 connections Sep 07 13:05:53.968556 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: your mercy for graceful operations on workers is 90 seconds Sep 07 13:05:53.969123 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 13:05:53.969232 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: *** Operational MODE: preforking *** Sep 07 13:05:53.969682 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: *** uWSGI is running in multiple interpreter mode *** Sep 07 13:05:53.969682 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: spawned uWSGI master process (pid: 105896) Sep 07 13:05:53.969960 dv-cinder-804035-50-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 13:05:53.971619 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: spawned uWSGI worker 1 (pid: 105897, cores: 1) Sep 07 13:05:53.971619 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: spawned uWSGI worker 2 (pid: 105898, cores: 1) Sep 07 13:05:53.971619 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 13:05:54.900251 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:05:54.910775 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:05:56.033856 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:56.033856 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: from cryptography.utils import int_from_bytes Sep 07 13:05:56.034590 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:56.034590 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: from cryptography.utils import int_from_bytes Sep 07 13:05:56.885955 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:56.885955 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: from cryptography.utils import int_from_bytes Sep 07 13:05:56.886957 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:56.886957 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: from cryptography.utils import int_from_bytes Sep 07 13:05:59.394432 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:05:59.395043 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:05:59.395285 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:05:59.395524 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:05:59.395779 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:05:59.396167 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.396528 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.396850 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.397170 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.397514 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.397817 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.398138 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.398453 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.398781 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.399041 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.399395 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.399721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-50-iscsi {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.400044 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.400357 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.400667 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.400987 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.401289 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.401611 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.401920 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.402427 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.402881 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.403268 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.403685 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.404033 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.404348 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.404658 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.404977 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.405286 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.405618 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.405939 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.406354 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-50-iscsi {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.406669 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.406969 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.407316 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.407750 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.408068 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.408381 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.408701 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.409027 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.409340 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.409669 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.410008 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.410316 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.410637 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.410941 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.411357 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.411671 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.411993 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.412853 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.413165 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.413420 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.413732 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.414056 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.414379 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.414704 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.414958 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.415241 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.415567 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.415894 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.416207 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.416520 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.416835 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.417145 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.417457 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.417774 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.418087 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.418395 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.418715 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.419030 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.419391 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.419704 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.420025 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.420439 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.420693 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.421002 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.421347 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.421666 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.421981 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.422303 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.422623 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.422934 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.423285 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.423599 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.423929 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.424268 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.424573 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.424824 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.425126 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.425431 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.425751 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.426061 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.426371 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.426682 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.426984 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.427316 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.427626 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.428594 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.428803 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.429113 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.429422 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.429731 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.430041 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.430347 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.430649 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.430979 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.431326 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.431636 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.431944 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.432255 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.432563 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.432883 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.433203 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.433518 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.433836 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.434144 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.434484 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.434914 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.435334 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.435646 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.435969 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.436274 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.436584 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.436904 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.437213 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.437542 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.437847 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.438151 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.438456 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.438769 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.439067 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.439402 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.439705 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.440028 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.440347 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.440658 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.440965 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.441270 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.441589 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:59.441929 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.442262 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.442609 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.442927 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.443895 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.444235 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.444560 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.444874 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.445193 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.445522 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.445835 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.446148 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.446459 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.446780 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.447128 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.447449 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.447767 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.448085 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.448407 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.448718 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.449124 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.449427 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.449753 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.450067 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.450412 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.450762 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.451075 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.451588 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.451921 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.452237 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.452552 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.452865 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.453216 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.453534 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.453852 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.454181 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.454495 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.454823 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.455165 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.455478 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.455794 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.456112 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.456423 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.456764 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.457084 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.457408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.457729 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.458045 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.458366 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.458685 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.459061 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.459919 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.460214 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.460564 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.460876 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.461194 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.461503 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.461830 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.462166 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.462475 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.462815 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.463137 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.463458 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.463772 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.464093 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.464400 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.464717 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.465029 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.465339 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.465662 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.465975 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.466282 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.466610 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.466918 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.467260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.467585 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.467900 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.468216 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.468536 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.468844 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.469171 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.469487 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.469802 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.470267 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.470598 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.470909 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.471273 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.471604 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.471925 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.472232 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.472546 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.472853 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.473162 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.473467 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.473776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.474087 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.474393 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.474727 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.475035 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.475376 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.475698 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.476010 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.476314 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.476618 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.476923 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.477266 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.477573 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.477915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.478254 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.478574 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.478898 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.479240 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.479561 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.479873 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.480198 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.480511 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.480822 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.481144 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.481459 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.481783 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.482096 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.482424 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.482735 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.483059 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.483544 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.483868 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.484217 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.484557 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.484875 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.485196 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.485518 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.485831 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.486141 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.486454 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.486765 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.487075 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.487423 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.487737 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.488059 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.488385 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.488760 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.489077 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.489398 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.489703 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.490020 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.490890 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.491247 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.491562 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.491878 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.492199 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.492513 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.493089 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.493401 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.493708 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.494015 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.494327 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.494650 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.494963 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.495302 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.495611 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.495927 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.496235 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.496541 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.496843 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.497160 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.497485 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.497796 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.498119 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.498443 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.498748 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.499052 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.499408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.499721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.500026 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.500331 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.500636 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.501013 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.501288 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.501594 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.501914 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.502238 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.502550 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.502869 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.503210 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.503526 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.503855 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.504175 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.504491 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.504806 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.505115 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.505427 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.505739 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.506637 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.506951 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.507295 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.507610 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.507916 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.508229 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.508551 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.509147 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.509485 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.509803 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.510124 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.510471 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.510795 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.511230 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.511480 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.511798 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.512107 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.512424 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.512965 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.513363 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.513685 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.513999 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.514310 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.514626 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.514940 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.515288 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.515601 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.515910 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.516220 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.516541 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.516849 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.517166 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.517474 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.517806 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.518120 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.518426 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.518732 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.519039 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.519419 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.519726 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.520069 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.520400 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.520744 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.521053 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.521456 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.521717 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.522026 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.522333 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.522639 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.522952 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.523297 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.523604 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.523919 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.524231 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.524550 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.524861 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.525165 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.525474 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.525779 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.526095 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.526405 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.526709 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.527013 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.527352 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.527661 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.527965 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.528276 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.528582 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.528902 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.529211 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.529515 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.529819 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.530131 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.530439 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.530743 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.531084 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.531430 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.531725 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.532028 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.532339 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.532644 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.532947 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.533259 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.533582 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.533898 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.534203 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.534527 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.534832 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.535159 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.535469 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.535779 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.536084 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.536397 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.536696 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.537000 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.537339 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.537667 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.537979 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.538287 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.538592 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.538896 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.539271 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.539578 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.539942 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.540253 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.540571 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.540893 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.541209 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.541524 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.541909 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.542141 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.542459 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.542771 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.543086 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.543416 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.543733 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.544171 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.544495 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.544812 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.545141 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.545557 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.545889 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.546197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.546515 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.546824 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.547159 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.547477 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.547789 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.548102 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.548419 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.548732 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.549048 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.549361 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.549669 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.549982 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.550291 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.550597 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.550926 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.551267 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.551577 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.551891 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.552198 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.552508 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.553351 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.553806 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.554123 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.554445 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.554754 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.555068 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.555413 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.555733 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.556056 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.556365 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.556797 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.557110 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.557424 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.557741 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.558062 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.558369 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.558681 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.559008 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.559344 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.559652 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.559956 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.560282 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.560590 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.560913 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.561338 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.561652 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.561959 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.562537 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.562851 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.563291 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.563556 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.563853 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.564160 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.564468 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.564786 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.565106 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.565425 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.565787 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.566062 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.566371 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.566679 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.567004 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.567359 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.567678 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.568006 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.568998 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.569326 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.569642 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.569969 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.570293 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.570602 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.570909 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.571249 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.571559 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.571869 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.572195 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.572515 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.572827 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.573138 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.573449 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.573757 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.574064 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.574392 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.574703 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.575027 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.575549 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.575876 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.576199 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.576508 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.576835 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.577150 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.577456 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.577765 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.578071 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.578418 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.578726 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.579049 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.579414 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.579748 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.580063 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.580400 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.580731 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.581056 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.581372 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.581691 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.582020 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.582330 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.582648 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.582961 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.583298 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.583610 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.583950 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.584264 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.584580 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.584888 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.585199 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.585533 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.585846 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.586175 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.586489 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.586798 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.587134 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.587443 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.587796 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.588105 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.588440 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.588751 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.589080 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.589402 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.589719 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.590040 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.590359 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.590678 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.590996 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.591345 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.591658 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.591977 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.592296 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.592614 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.593199 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.593530 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.593847 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.594166 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.594489 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.594808 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.595146 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.595465 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.595779 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.596091 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.596404 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.596738 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.597066 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.597398 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.597735 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.598060 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.598380 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.598698 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.599016 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.599407 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.599761 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.600074 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.600393 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.600713 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.601029 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.601346 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.601661 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.601978 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.602295 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.602610 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.602923 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.603269 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.603585 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.603915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.604256 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.604588 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.604906 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.605223 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.605542 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.606115 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.606839 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.607064 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.607353 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.607685 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.608003 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.608327 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.608657 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.608966 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.609275 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.609590 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.609902 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.610208 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.610531 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.610845 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.611176 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.611500 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.611813 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.612383 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.612738 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.613062 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.613391 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.613715 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.614036 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.614345 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.614675 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.614985 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.615865 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.616188 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.616501 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.616805 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.617111 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.617428 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.617745 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.618309 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.618621 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.618929 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.619293 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.619605 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.619912 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.620219 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.620534 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.620841 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.621148 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.621457 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.621762 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.622266 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.622580 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.622896 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.623241 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.623560 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.623920 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.624235 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.624544 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.624884 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.625193 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.625500 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.625824 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.626138 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.626462 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.626779 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.627093 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.627475 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.627798 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.628390 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.628725 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.629046 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.629390 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.629722 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.630030 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.630336 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.630642 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.631605 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.631872 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.632190 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.632502 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.632814 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.633126 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.633441 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.633754 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.634063 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.634375 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.634685 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.635001 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.635340 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.635651 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.635963 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.636282 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.636629 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.636953 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.637274 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.637709 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.638075 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.638386 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.638702 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.639026 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.639374 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.639696 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.640032 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.640352 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.640660 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.641388 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.641711 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.642037 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.642366 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.642682 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.643008 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.643367 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.643694 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.644015 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.644327 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.644711 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.645013 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.645345 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.645674 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.645984 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.646292 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.646634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.646947 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.647301 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.647616 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.647921 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.648234 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.648544 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.648852 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.649157 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.649462 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.649769 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.650079 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.650382 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.650689 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.650995 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.651330 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.651639 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.651943 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.652256 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.652562 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.652868 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.653186 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.653653 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.654166 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.654398 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.654737 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.655064 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.655423 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.655741 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.656066 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.656382 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.656708 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.657034 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.657360 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.657672 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.658010 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.658330 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.658645 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.658964 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.659317 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.659638 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.659958 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.660297 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.660626 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.660938 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.661269 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.661592 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.661919 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.662269 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.662585 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.662918 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.663264 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.663584 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.663897 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.664313 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.664527 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.664846 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.665165 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.665482 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.665804 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.666122 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.666454 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.666794 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.667143 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.667463 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.667794 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.668148 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.668468 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.668812 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.669141 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.669456 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.669774 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.670083 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:59.670329 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:05:59.826667 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO dbcounter [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Registered counter for database nova_api Sep 07 13:05:59.851433 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_db.sqlalchemy.engines [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:59.858480 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writer thread running {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:59.919502 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.context [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03b1f7e0-85a9-4e40-963d-59c98178354b(cell1) {{(pid=105898) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:05:59.923682 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:59.924179 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:59.925809 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:59.926581 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:59.927033 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:59.929176 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:59.931336 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO dbcounter [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Registered counter for database nova_cell0 Sep 07 13:05:59.935983 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO dbcounter [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Registered counter for database nova_cell1 Sep 07 13:05:59.944305 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_db.sqlalchemy.engines [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:59.950169 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writer thread running {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:59.950835 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_db.sqlalchemy.engines [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:06:00.113227 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writer thread running {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:06:00.123721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO dbcounter [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Registered counter for database nova_cell0 Sep 07 13:06:00.131469 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_db.sqlalchemy.engines [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:06:00.136680 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writer thread running {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:06:00.500805 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: WARNING keystonemiddleware.auth_token [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:06:00.508821 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: WARNING keystonemiddleware.auth_token [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:06:00.866557 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: WARNING keystonemiddleware.auth_token [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:06:00.873365 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: WARNING keystonemiddleware.auth_token [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:06:00.879409 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557b0859e9c0 pid: 105898 (default app) Sep 07 13:06:00.881783 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:00.883133 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002001 Sep 07 13:06:00.883574 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Wed Sep 7 13:06:00 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:00.959714 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:06:00.960251 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:06:00.961068 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:06:00.961710 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:06:00.962165 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:06:00.962830 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.963410 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.963942 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.964485 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.965082 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.965638 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.966219 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.966796 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.967401 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.967853 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.968402 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.968971 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-50-iscsi {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.969526 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.970068 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.970646 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.971230 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.971736 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.972282 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.972817 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.973748 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.974324 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.975586 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.976148 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.976788 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.977412 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.978001 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.978638 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.979240 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.979799 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.980309 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.981030 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-50-iscsi {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.981592 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.982144 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.982698 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.983471 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.984035 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.984603 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.985192 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.985737 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.986279 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.986901 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.987511 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.988070 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.988630 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.989192 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.989770 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.990605 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.991243 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.991792 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.992322 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.992785 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.993578 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.994132 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.994689 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.995259 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.995690 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.996130 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.996713 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.997282 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.997858 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.998426 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.998945 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:00.999541 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.000109 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.000692 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.001230 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.001790 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.002387 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.002982 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.003597 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.004153 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.004760 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.005473 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.006006 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.006459 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.006822 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.007190 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.007515 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.007843 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.008175 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.008499 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.008808 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.009155 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.009424 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.009750 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.010057 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.010306 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.010609 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.010953 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.011281 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.011554 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.011860 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.012167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.012466 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.012767 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.013071 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.013377 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.013707 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.014011 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.014286 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.014615 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.015412 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.015730 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.016041 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.016372 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.016698 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.017005 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.017309 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.018433 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.018433 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.018433 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.019404 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.019404 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.019404 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.020042 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.020344 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.020811 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.021254 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.022320 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.022867 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.023343 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.023851 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.024296 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.024718 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.025152 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.025648 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.026141 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.026584 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.026936 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.027405 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.027781 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.028158 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.028709 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.029236 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.029767 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.030265 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.030720 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.031204 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:06:01.031663 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.032091 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.032608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.033115 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.033584 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.034019 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.034432 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.034884 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.035396 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.035897 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.036314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.036732 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.037854 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.038331 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.038776 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.039276 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.039711 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.040126 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.040629 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.041037 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.041554 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.041984 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.042410 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.042820 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.043359 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.043836 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.044271 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.044719 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.045209 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.045720 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.046109 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.046576 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.047181 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.047705 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.048129 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.049118 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.049118 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.049488 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.049942 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.050351 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.050806 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.051269 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.051720 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.052185 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.052599 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.053132 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.053663 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.054143 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.054563 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.054997 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.055469 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.055927 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.056353 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.056781 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.057306 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.057901 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.058403 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.058853 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.059412 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.059899 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.060307 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.060727 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.061262 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.061767 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.062172 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.062665 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.063129 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.063579 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.064102 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.064602 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.066054 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.066054 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.066487 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.066694 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.067920 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.067920 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.068397 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.068905 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.069277 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.069708 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.070175 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.070625 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.071167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.071991 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.072277 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.072823 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.073407 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.073991 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.075308 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.075308 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.076551 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.076551 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.077013 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.077179 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.077535 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.077932 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.078295 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.078705 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.079222 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.079639 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.080068 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.080610 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.081133 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.081626 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.082045 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.082676 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.083138 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.083582 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.085071 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.085240 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.085671 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.086088 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.086507 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.086933 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.087467 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.087935 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.088421 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.088957 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.089527 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.090101 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.091571 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.091571 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.092078 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.092323 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.092824 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.093394 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.094058 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.094434 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.094979 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.095452 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.095828 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.096203 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.096572 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.096939 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.097304 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.097666 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.098037 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.098400 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.098826 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.099377 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.100525 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.100890 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.101263 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.101646 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.102033 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.102435 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.102891 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.103455 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.104024 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.104491 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.104871 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.105249 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.105623 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.106118 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.106634 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.107054 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.107496 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.107907 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.108431 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.108819 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.109210 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.109585 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.109969 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.110338 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.110789 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.111284 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.111732 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.112284 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.112778 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.113142 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.113644 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.114175 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.114655 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.115021 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.115649 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.116084 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.116489 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.116904 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.117241 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.117627 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.118402 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.118992 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.119421 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.119837 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.120219 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.120600 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.121115 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.121620 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.122031 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.122413 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.123194 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.123361 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.123752 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.124210 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.125567 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.125567 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.125567 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.126132 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.126639 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.127532 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.128082 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.128581 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.129003 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.129481 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.130006 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.130576 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.136900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.138577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.140067 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.140067 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.140067 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.140591 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.140740 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.141099 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.141549 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.141956 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.142414 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.142823 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.143335 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.143845 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.144285 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.144702 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.145114 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.145539 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.145944 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.146346 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.147409 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.147831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.148246 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.148668 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.149082 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.149491 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.149901 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.150316 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.150726 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.151192 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.151578 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.151990 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.152396 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.152877 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.153321 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.153771 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.154230 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.154714 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.155304 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.155813 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.156417 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.156851 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.157240 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.157599 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.157959 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.158386 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.158789 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.159289 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.159753 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.160196 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.160644 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.161093 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.161537 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.161980 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.163043 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.163496 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.163925 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.164326 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.164767 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.165170 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.165573 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.165976 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.166418 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.166823 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.167337 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.167764 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.168200 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.168747 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.169357 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.169919 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.170234 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.170662 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.171198 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.171578 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.171950 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.172389 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.172773 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.173156 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.173541 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.173966 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.174396 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.174895 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.175411 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.175893 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.176370 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.176756 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.177126 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.177500 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.177958 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.178414 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.178866 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.179354 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.179801 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.180222 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.180674 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.181121 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.181604 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.182104 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.184766 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.184766 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.184766 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.185255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.185535 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.185945 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.186507 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.186982 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.187511 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.188012 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.188772 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.189089 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.189831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.190131 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.190526 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.190926 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.191360 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.191833 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.192578 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.192995 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.193544 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.194004 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.194546 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.195486 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.195486 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.195905 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.196263 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.197003 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.197457 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.197923 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.198388 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.198886 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.199377 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.199950 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.200464 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.200917 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.201325 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.201754 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.202198 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.202723 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.203318 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.204015 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.204537 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.205079 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.205771 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.206315 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.206852 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.207338 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.207856 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.208410 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.208812 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.209816 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.210232 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.210659 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.211140 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.211637 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.212057 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.212451 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.213002 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.213498 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.213891 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.214348 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.214922 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.215404 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.215849 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.216283 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.216707 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.217194 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.217628 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.218067 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.218485 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.218890 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.219368 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.219783 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.220196 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.220607 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.221041 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.221477 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.221911 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.222446 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.222983 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.223558 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.224104 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.225355 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.225899 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.226411 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.226955 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.227453 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.227898 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.228314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.228772 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.229234 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.229690 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.230143 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.230596 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.231046 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.231519 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.231962 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.232445 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.233184 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.233356 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.233775 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.234231 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.234688 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.235326 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.235761 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.236284 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.236752 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.237118 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.237623 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.238132 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.238582 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.239027 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.239533 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.239959 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.240470 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.240884 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.241307 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.241735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.242175 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.242651 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.243393 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.243856 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.244281 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.244729 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.245176 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.245612 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.246069 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.246508 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.246930 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.247426 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.247969 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.248482 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.248900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.249290 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.249750 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.250472 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.250900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.251369 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.251810 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.252231 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.252643 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.253083 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.253514 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.253925 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.254341 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.254780 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.255298 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.255730 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.256338 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.256804 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.257194 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.257576 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.257962 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.258381 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.258865 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.259345 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.259777 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.260204 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.260738 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.261225 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.261593 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.261957 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.262326 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.262800 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.263189 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.264376 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.264376 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.264687 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.265142 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.265606 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.266067 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.266481 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.266920 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.267402 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.268066 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.268488 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.269015 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.269549 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.270109 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.270622 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.271076 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.272242 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.272955 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.273408 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.273807 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.274246 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.274726 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.275231 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.275646 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.276063 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.276456 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.276812 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.277653 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.278031 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.278533 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.279087 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.279669 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.280151 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.280591 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.281012 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.281535 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.282042 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.282456 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.282972 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.283527 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.284021 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.284409 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.284802 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.285320 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.285826 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.286331 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.286890 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.288125 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.288618 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.289052 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.289565 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.290083 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.290569 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.290979 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.291391 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.291914 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.292430 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.292921 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.293306 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.293699 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.294248 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.294755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.295275 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.295679 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.296056 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.296450 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.296988 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.297496 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.297935 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.298350 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.298885 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.299461 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.299853 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.300677 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.301223 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.301771 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.302321 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.302905 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.303453 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.304665 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.304665 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.305037 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.305469 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.306011 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.306529 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.307062 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.307606 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.308128 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.308663 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.309166 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.309720 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.309942 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.310323 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.310700 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.311075 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.311546 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.312054 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.312475 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.312843 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.313203 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.313563 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.314033 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.314494 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.314895 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.315384 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.315847 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.316251 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.316695 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.317116 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.317519 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.318971 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.319442 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.319878 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.320330 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.320870 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.321425 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.321903 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.322287 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.322739 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.323282 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.323690 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.324123 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.324640 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.325189 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.325692 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.326106 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.326590 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.327135 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.327674 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.328206 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.328611 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.329040 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.329570 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.330087 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.330582 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.331058 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.331697 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.332234 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.332607 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.332986 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.333462 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.334639 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.335137 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.335671 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.336188 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.336707 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.337095 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.337471 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.337897 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.338406 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.338942 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.339391 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.339822 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.340219 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.340879 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.341276 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.341683 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.342073 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.342577 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.343006 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.343420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.343830 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.344352 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.344987 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.345401 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.345907 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.346299 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.346806 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.347392 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.347922 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.348325 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.348752 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.349295 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.349863 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.350315 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.350755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.351264 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.351687 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.352097 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.352532 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.352973 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.353391 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.353837 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.354271 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.354683 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.355126 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.355568 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.356023 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.356452 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.356860 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.357283 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.357744 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.358228 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.358701 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.359305 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.359801 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.360182 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.360551 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.361044 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:06:01.361449 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:06:01.535542 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Registered counter for database nova_api Sep 07 13:06:01.564387 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:06:01.574020 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:06:01.648269 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.context [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03b1f7e0-85a9-4e40-963d-59c98178354b(cell1) {{(pid=105897) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:06:01.654510 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:01.655325 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:01.658377 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:01.659691 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:01.660463 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:01.664357 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:01.666710 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Registered counter for database nova_cell0 Sep 07 13:06:01.672719 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Registered counter for database nova_cell1 Sep 07 13:06:01.686267 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:06:01.690714 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:06:01.698651 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:06:01.706491 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:06:01.861878 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Registered counter for database nova_cell0 Sep 07 13:06:01.873937 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:06:01.882677 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:06:02.253681 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:06:02.261446 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:06:02.618904 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:06:02.630382 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-5b6dfe0e-ae3e-4c46-83e7-0af825084a8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:06:02.641263 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x557b0859e9c0 pid: 105897 (default app) Sep 07 13:07:46.156636 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:46.157714 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 07 13:07:46.158124 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:46.175455 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:46.176528 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell0:SELECT=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:46.177981 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell1:SELECT=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:46.179034 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell0:SELECT=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:47.730990 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-7e41fc8b-bd1c-441e-b092-5eb4ad65fd33 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:47.788331 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-7e41fc8b-bd1c-441e-b092-5eb4ad65fd33 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.622349 Sep 07 13:07:47.789282 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Sep 7 13:07:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:51.620892 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:51.622066 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-cc09a0cc-47bd-4b27-9e0b-8c3a467cadc0 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 Sep 07 13:07:51.622494 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:52.122383 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-e10efd16-0369-4726-881f-1d757c695936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "name": "cirros256", "disk": 1, "vcpus": 1}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:52.183422 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-e10efd16-0369-4726-881f-1d757c695936 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.553398 Sep 07 13:07:52.183900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:07:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:07:52.203790 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_api:SELECT=3 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:52.205141 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_cell0:SELECT=3 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:52.208417 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_cell1:SELECT=3 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:52.209506 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:52.465524 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-6f681eca-198e-4479-907b-6b58faed4c4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:52.534242 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-6f681eca-198e-4479-907b-6b58faed4c4d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339774 Sep 07 13:07:52.534862 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Sep 7 13:07:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:55.369315 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-e10efd16-0369-4726-881f-1d757c695936 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:55.370235 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-e10efd16-0369-4726-881f-1d757c695936 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 07 13:07:55.371524 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:56.512983 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-e3524882-c3e7-4430-9d1e-5ca4e9e257ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:56.570254 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-e3524882-c3e7-4430-9d1e-5ca4e9e257ee admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.190961 Sep 07 13:07:56.572880 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:07:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:07:56.591245 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-fd629c40-4122-4299-80d7-dd8f8b43e5be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:56.646420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-fd629c40-4122-4299-80d7-dd8f8b43e5be admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062149 Sep 07 13:07:56.647361 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Sep 7 13:07:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:59.944907 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-e3524882-c3e7-4430-9d1e-5ca4e9e257ee admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:59.945951 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-e3524882-c3e7-4430-9d1e-5ca4e9e257ee admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 07 13:07:59.946380 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:07:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:00.481800 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-8cf122e4-65c2-44e5-a8d0-a1932ac53658 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:00.503988 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-8cf122e4-65c2-44e5-a8d0-a1932ac53658 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550286 Sep 07 13:08:00.504570 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:07:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:08:00.517380 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-898f3bbf-feb4-4bb7-aa06-1800fcd5b127 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:00.548281 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-898f3bbf-feb4-4bb7-aa06-1800fcd5b127 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034721 Sep 07 13:08:00.549078 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Sep 7 13:08:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:03.519462 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-8cf122e4-65c2-44e5-a8d0-a1932ac53658 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:03.521661 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-8cf122e4-65c2-44e5-a8d0-a1932ac53658 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002836 Sep 07 13:08:03.522373 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:04.266453 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-6adce869-9cea-4e35-aef2-23d1e0353134 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:04.299862 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-6adce869-9cea-4e35-aef2-23d1e0353134 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.769255 Sep 07 13:08:04.300900 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:08:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:08:04.323465 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-219167e3-82b8-4027-b857-e53eeb176adb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:04.369300 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-219167e3-82b8-4027-b857-e53eeb176adb admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053105 Sep 07 13:08:04.383884 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Sep 7 13:08:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:07.908044 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-6adce869-9cea-4e35-aef2-23d1e0353134 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:07.909952 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-6adce869-9cea-4e35-aef2-23d1e0353134 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002820 Sep 07 13:08:07.910710 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:08.670108 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-4562f485-70ed-4976-935c-1a1369ffbbe3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:08.696596 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-4562f485-70ed-4976-935c-1a1369ffbbe3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.776963 Sep 07 13:08:08.697346 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:08:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:08:08.717939 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-25ae76e2-33b3-4e15-81e8-c6c8e58e6e93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:08.753651 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-25ae76e2-33b3-4e15-81e8-c6c8e58e6e93 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040567 Sep 07 13:08:08.754608 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Sep 7 13:08:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:12.251128 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-4562f485-70ed-4976-935c-1a1369ffbbe3 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:12.252221 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-4562f485-70ed-4976-935c-1a1369ffbbe3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 07 13:08:12.252590 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:12.925471 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-7f7831e2-43a6-406a-9531-3b16ae789169 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:12.961728 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-7f7831e2-43a6-406a-9531-3b16ae789169 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.701112 Sep 07 13:08:12.962455 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Sep 7 13:08:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:08:16.387294 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-4562f485-70ed-4976-935c-1a1369ffbbe3 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:16.388379 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-4562f485-70ed-4976-935c-1a1369ffbbe3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Sep 07 13:08:16.388752 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:16.908552 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-a751587e-9020-4596-8b61-04df9fa2f12e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:16.932075 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-a751587e-9020-4596-8b61-04df9fa2f12e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.536879 Sep 07 13:08:16.932666 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:08:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:16.950024 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-577a5fb4-1080-4ee1-9f9e-4f50e9733a1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:16.958900 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:16.995697 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-577a5fb4-1080-4ee1-9f9e-4f50e9733a1f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053539 Sep 07 13:08:16.996748 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Sep 7 13:08:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:19.966729 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-a751587e-9020-4596-8b61-04df9fa2f12e admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:19.972306 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-a751587e-9020-4596-8b61-04df9fa2f12e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002584 Sep 07 13:08:19.974076 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:20.607520 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-1f42754e-03e7-47ed-8592-1faf5cf44db9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:20.631034 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-1f42754e-03e7-47ed-8592-1faf5cf44db9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.649748 Sep 07 13:08:20.631654 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:08:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:20.648829 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-2002855f-34d7-413a-a588-421851edf34d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:20.686865 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-2002855f-34d7-413a-a588-421851edf34d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044810 Sep 07 13:08:20.688047 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Sep 7 13:08:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:23.623697 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-1f42754e-03e7-47ed-8592-1faf5cf44db9 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:23.634019 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-1f42754e-03e7-47ed-8592-1faf5cf44db9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.009775 Sep 07 13:08:23.637559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:24.233654 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-2afb83d1-92fc-4c6c-89c5-c443135a30dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "disk": 40}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:24.243390 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:24.259862 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-2afb83d1-92fc-4c6c-89c5-c443135a30dc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.617031 Sep 07 13:08:24.260428 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:08:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:08:24.277878 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-9e4304c4-4eb7-4552-8c3a-92bfee717ec7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:24.311782 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-9e4304c4-4eb7-4552-8c3a-92bfee717ec7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037752 Sep 07 13:08:24.313063 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Sep 7 13:08:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:27.588315 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-2afb83d1-92fc-4c6c-89c5-c443135a30dc admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:27.589351 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-2afb83d1-92fc-4c6c-89c5-c443135a30dc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 07 13:08:27.589770 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:28.304070 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-2ce3ea83-905a-408e-a0c1-e1030a5ea015 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:28.341396 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-2ce3ea83-905a-408e-a0c1-e1030a5ea015 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.744314 Sep 07 13:08:28.343175 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:08:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:28.361875 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-709abb92-28ec-4e37-874d-c06c7956e08a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:28.416902 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-709abb92-28ec-4e37-874d-c06c7956e08a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064291 Sep 07 13:08:28.417543 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Sep 7 13:08:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:31.481649 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-2ce3ea83-905a-408e-a0c1-e1030a5ea015 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:31.482683 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-2ce3ea83-905a-408e-a0c1-e1030a5ea015 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 07 13:08:31.487641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:32.115923 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-1d46d7e9-0db4-4ef4-9e51-5433916d06c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:32.149532 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-1d46d7e9-0db4-4ef4-9e51-5433916d06c7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.659339 Sep 07 13:08:32.150374 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Sep 7 13:08:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:32.169138 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ed5b99d9-ceb2-4219-aafd-d6d54d27d0d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:32.218445 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ed5b99d9-ceb2-4219-aafd-d6d54d27d0d1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057134 Sep 07 13:08:32.219737 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Sep 7 13:08:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:48.392598 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-1d46d7e9-0db4-4ef4-9e51-5433916d06c7 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:48.393621 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-1d46d7e9-0db4-4ef4-9e51-5433916d06c7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 07 13:08:48.394026 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:08:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:48.408630 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:48.879119 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-9448529e-acd9-43ce-b4b6-4cbe63a7b4a9 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:48.913416 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-9448529e-acd9-43ce-b4b6-4cbe63a7b4a9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.509081 Sep 07 13:08:48.914231 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Sep 7 13:08:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:50.386911 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-1d46d7e9-0db4-4ef4-9e51-5433916d06c7 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:50.388081 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-1d46d7e9-0db4-4ef4-9e51-5433916d06c7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Sep 07 13:08:50.388486 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:51.049386 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-247b3168-fbea-4ab2-8012-d6157073fa4f admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:51.056180 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.wsgi [None req-247b3168-fbea-4ab2-8012-d6157073fa4f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-247b3168-fbea-4ab2-8012-d6157073fa4f admin admin] Request method failure captured: Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Accept: application/json Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Accept-Encoding: gzip, deflate Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Connection: keep-alive Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Content-Length: 0 Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Host: 10.222.0.61 Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Openstack-Api-Version: compute 2.92 Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Openstack-System-Scope: None Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: User-Agent: python-novaclient Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Auth-Token: gAAAAABjGJfiv-RucClncB8_DABauCGp01CVnGJKWOzzJVBQWi1q4QGPe5vdUzdoBSTnHiqZuRwILhoM_PRwy2K5wVoIYc8W0fZCBiLJ-XinPZn1K2pm-qyyRxzqviPRhKu3W7RJDCDElad3YzdU2BHw28ahUoAum0Ohk6CwPOos6GmNBjXlf2Q Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Domain-Id: None Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Domain-Name: None Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Identity-Status: Confirmed Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Is-Admin-Project: True Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Domain-Id: default Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Domain-Name: Default Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Name: admin Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Role: admin,reader,member Sep 07 13:08:51.059641 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Roles: admin,reader,member Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2f256a069ba947c6a6b8cccfea6c7a22"}]}] Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant: admin Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant-Name: admin Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User: admin Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Domain-Id: default Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Domain-Name: Default Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Id: 8bfb2d4384094e9e8a8b910061e5c9d4 Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Name: admin Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: method: > Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: exception: Flavor 42 could not be found. Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: action_args: {'id': '42'} Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:51.062427 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:51.064420 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.067167 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-247b3168-fbea-4ab2-8012-d6157073fa4f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:51.069659 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-247b3168-fbea-4ab2-8012-d6157073fa4f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.483139 Sep 07 13:08:51.069659 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Sep 7 13:08:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:51.078417 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-5f21192f-a866-43d3-954a-e98a0646808f admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:51.083277 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:51.105734 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-5f21192f-a866-43d3-954a-e98a0646808f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030953 Sep 07 13:08:51.106340 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Sep 7 13:08:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:51.117432 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-6c234b4b-cbdd-43cf-863d-68aff5615bc3 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:51.141312 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-6c234b4b-cbdd-43cf-863d-68aff5615bc3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027986 Sep 07 13:08:51.141896 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Sep 7 13:08:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:51.154821 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-5f24425e-e0a7-48b7-9726-548cdd64ab5a admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:51.166093 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.wsgi [None req-5f24425e-e0a7-48b7-9726-548cdd64ab5a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-5f24425e-e0a7-48b7-9726-548cdd64ab5a admin admin] Request method failure captured: Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Accept: application/json Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Accept-Encoding: gzip, deflate Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Connection: keep-alive Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Content-Length: 0 Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Host: 10.222.0.61 Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Openstack-Api-Version: compute 2.92 Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Openstack-System-Scope: None Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: User-Agent: python-novaclient Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Auth-Token: gAAAAABjGJfiv-RucClncB8_DABauCGp01CVnGJKWOzzJVBQWi1q4QGPe5vdUzdoBSTnHiqZuRwILhoM_PRwy2K5wVoIYc8W0fZCBiLJ-XinPZn1K2pm-qyyRxzqviPRhKu3W7RJDCDElad3YzdU2BHw28ahUoAum0Ohk6CwPOos6GmNBjXlf2Q Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Domain-Id: None Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Domain-Name: None Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Identity-Status: Confirmed Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Is-Admin-Project: True Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Domain-Id: default Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Domain-Name: Default Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Name: admin Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Role: admin,reader,member Sep 07 13:08:51.172197 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Roles: admin,reader,member Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2f256a069ba947c6a6b8cccfea6c7a22"}]}] Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant: admin Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant-Name: admin Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User: admin Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Domain-Id: default Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Domain-Name: Default Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Id: 8bfb2d4384094e9e8a8b910061e5c9d4 Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Name: admin Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: method: > Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: exception: Flavor 42 could not be found. Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: action_args: {'id': '42'} Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:51.173784 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:51.174721 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:51.176595 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-5f24425e-e0a7-48b7-9726-548cdd64ab5a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:51.177609 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-5f24425e-e0a7-48b7-9726-548cdd64ab5a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.025995 Sep 07 13:08:51.177609 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Sep 7 13:08:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:52.528782 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-6c234b4b-cbdd-43cf-863d-68aff5615bc3 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:52.530521 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-6c234b4b-cbdd-43cf-863d-68aff5615bc3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002566 Sep 07 13:08:52.531307 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:53.258371 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-18d26307-9dd3-4e5d-a834-3b6e7bf2415a admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:53.266309 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.wsgi [None req-18d26307-9dd3-4e5d-a834-3b6e7bf2415a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-18d26307-9dd3-4e5d-a834-3b6e7bf2415a admin admin] Request method failure captured: Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Accept: application/json Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Accept-Encoding: gzip, deflate Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Connection: keep-alive Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Content-Length: 0 Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Host: 10.222.0.61 Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Openstack-Api-Version: compute 2.92 Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Openstack-System-Scope: None Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: User-Agent: python-novaclient Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Auth-Token: gAAAAABjGJfkZ9ZnWTQfshI77nQDbqdpP8YGZaS3_ODPeeuyUYkeg8figTEz8K-xyl77JvRwUauyfJOWPHV4m5W5Tu6wGEp-0SYWrwnIAB9bBw7mtID033upHiYLurlg3rnZZ0XRvVnQhxPF2FU_0g3HDA5lHakrxXgAVzKKV-aHt6J00i4pths Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Domain-Id: None Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Domain-Name: None Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Identity-Status: Confirmed Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Is-Admin-Project: True Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Domain-Id: default Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Domain-Name: Default Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Name: admin Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Role: admin,reader,member Sep 07 13:08:53.268924 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Roles: admin,reader,member Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2f256a069ba947c6a6b8cccfea6c7a22"}]}] Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant: admin Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant-Name: admin Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User: admin Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Domain-Id: default Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Domain-Name: Default Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Id: 8bfb2d4384094e9e8a8b910061e5c9d4 Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Name: admin Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: method: > Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: exception: Flavor 84 could not be found. Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: action_args: {'id': '84'} Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:53.270377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:53.271261 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.272408 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-18d26307-9dd3-4e5d-a834-3b6e7bf2415a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:53.273486 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-18d26307-9dd3-4e5d-a834-3b6e7bf2415a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.475371 Sep 07 13:08:53.273486 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Sep 7 13:08:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:53.282761 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-29a60449-c8d9-4f53-bed7-63b98f40ca12 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:53.299530 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-29a60449-c8d9-4f53-bed7-63b98f40ca12 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020812 Sep 07 13:08:53.300122 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Sep 7 13:08:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:53.310955 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-5c48c26f-6f6d-47c6-922a-3cb4c76e332c admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:53.327344 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-5c48c26f-6f6d-47c6-922a-3cb4c76e332c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019971 Sep 07 13:08:53.327801 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Sep 7 13:08:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:53.338174 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-36217d59-99e9-41cc-ba0e-9ef9ba916953 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:53.345128 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.wsgi [None req-36217d59-99e9-41cc-ba0e-9ef9ba916953 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-36217d59-99e9-41cc-ba0e-9ef9ba916953 admin admin] Request method failure captured: Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Accept: application/json Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Accept-Encoding: gzip, deflate Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Connection: keep-alive Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Content-Length: 0 Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Host: 10.222.0.61 Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Openstack-Api-Version: compute 2.92 Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Openstack-System-Scope: None Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: User-Agent: python-novaclient Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Auth-Token: gAAAAABjGJfkZ9ZnWTQfshI77nQDbqdpP8YGZaS3_ODPeeuyUYkeg8figTEz8K-xyl77JvRwUauyfJOWPHV4m5W5Tu6wGEp-0SYWrwnIAB9bBw7mtID033upHiYLurlg3rnZZ0XRvVnQhxPF2FU_0g3HDA5lHakrxXgAVzKKV-aHt6J00i4pths Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Domain-Id: None Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Domain-Name: None Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Identity-Status: Confirmed Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Is-Admin-Project: True Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Domain-Id: default Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Domain-Name: Default Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Name: admin Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Role: admin,reader,member Sep 07 13:08:53.346735 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Roles: admin,reader,member Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2f256a069ba947c6a6b8cccfea6c7a22"}]}] Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant: admin Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant-Name: admin Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User: admin Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Domain-Id: default Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Domain-Name: Default Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Id: 8bfb2d4384094e9e8a8b910061e5c9d4 Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Name: admin Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: method: > Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: exception: Flavor 84 could not be found. Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: action_args: {'id': '84'} Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:53.348608 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:53.349447 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:53.350831 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-36217d59-99e9-41cc-ba0e-9ef9ba916953 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:53.352184 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-36217d59-99e9-41cc-ba0e-9ef9ba916953 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014749 Sep 07 13:08:53.352184 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Sep 7 13:08:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:54.697555 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-5c48c26f-6f6d-47c6-922a-3cb4c76e332c admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:54.698559 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-5c48c26f-6f6d-47c6-922a-3cb4c76e332c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Sep 07 13:08:54.698984 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:55.277499 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-84176d50-34fe-4f02-b016-c75875f033db admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:55.283659 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.wsgi [None req-84176d50-34fe-4f02-b016-c75875f033db admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-84176d50-34fe-4f02-b016-c75875f033db admin admin] Request method failure captured: Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Accept: application/json Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Accept-Encoding: gzip, deflate Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Connection: keep-alive Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Content-Length: 0 Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Host: 10.222.0.61 Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Openstack-Api-Version: compute 2.92 Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Openstack-System-Scope: None Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: User-Agent: python-novaclient Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Auth-Token: gAAAAABjGJfmCG6V73hUrTw-IfCC1ajt4BPlgc9APdBRzlr-1PgHfa-zLqfvZHJjjXb02NFQO7btuDvrMRLw1gTjYsxzYqMMqKWDS1uWLEC99xnN38K8w7fqXiemYl7UAeiWYlrKf9Rgf092-1eHSGh5DgJHI9QWB1jNn5A9z81GPg8unU4fKck Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Domain-Id: None Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Domain-Name: None Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Identity-Status: Confirmed Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Is-Admin-Project: True Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Domain-Id: default Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Domain-Name: Default Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Project-Name: admin Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Role: admin,reader,member Sep 07 13:08:55.285755 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Roles: admin,reader,member Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2f256a069ba947c6a6b8cccfea6c7a22"}]}] Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant: admin Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-Tenant-Name: admin Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User: admin Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Domain-Id: default Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Domain-Name: Default Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Id: 8bfb2d4384094e9e8a8b910061e5c9d4 Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: X-User-Name: admin Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: method: > Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: exception: Flavor 451 could not be found. Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: action_args: {'id': '451'} Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:55.287314 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:55.288255 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.289559 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-84176d50-34fe-4f02-b016-c75875f033db admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:55.290808 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-84176d50-34fe-4f02-b016-c75875f033db admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.445552 Sep 07 13:08:55.290808 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:55.301536 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-e22b6c0d-087f-4e49-bd5c-e86dc1d75c0f admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:55.318354 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-e22b6c0d-087f-4e49-bd5c-e86dc1d75c0f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020388 Sep 07 13:08:55.318932 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Sep 7 13:08:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:55.328879 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:55.345564 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020238 Sep 07 13:08:55.346478 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Sep 7 13:08:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:55.356892 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-ef5bfbd8-5071-4602-88fc-c54e2ac26ff9 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:55.362648 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.wsgi [None req-ef5bfbd8-5071-4602-88fc-c54e2ac26ff9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-ef5bfbd8-5071-4602-88fc-c54e2ac26ff9 admin admin] Request method failure captured: Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Accept: application/json Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Accept-Encoding: gzip, deflate Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Connection: keep-alive Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Content-Length: 0 Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Host: 10.222.0.61 Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Openstack-Api-Version: compute 2.92 Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Openstack-System-Scope: None Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: User-Agent: python-novaclient Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Auth-Token: gAAAAABjGJfmCG6V73hUrTw-IfCC1ajt4BPlgc9APdBRzlr-1PgHfa-zLqfvZHJjjXb02NFQO7btuDvrMRLw1gTjYsxzYqMMqKWDS1uWLEC99xnN38K8w7fqXiemYl7UAeiWYlrKf9Rgf092-1eHSGh5DgJHI9QWB1jNn5A9z81GPg8unU4fKck Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Domain-Id: None Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Domain-Name: None Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Identity-Status: Confirmed Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Is-Admin-Project: True Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Domain-Id: default Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Domain-Name: Default Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Project-Name: admin Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Role: admin,reader,member Sep 07 13:08:55.364260 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Roles: admin,reader,member Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2f256a069ba947c6a6b8cccfea6c7a22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2f256a069ba947c6a6b8cccfea6c7a22"}]}] Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant: admin Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant-Id: 2f256a069ba947c6a6b8cccfea6c7a22 Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-Tenant-Name: admin Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User: admin Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Domain-Id: default Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Domain-Name: Default Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Id: 8bfb2d4384094e9e8a8b910061e5c9d4 Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: X-User-Name: admin Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: method: > Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: exception: Flavor 451 could not be found. Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: action_args: {'id': '451'} Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:55.366634 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:55.367915 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: ERROR nova.api.openstack.wsgi Sep 07 13:08:55.369776 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-ef5bfbd8-5071-4602-88fc-c54e2ac26ff9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:55.371931 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-ef5bfbd8-5071-4602-88fc-c54e2ac26ff9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012737 Sep 07 13:08:55.371931 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:56.773417 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:56.774452 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 07 13:08:56.774882 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:57.533741 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-6585affc-a8a5-4452-bee5-7e002be12ead admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:57.560134 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-6585affc-a8a5-4452-bee5-7e002be12ead admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.516603 Sep 07 13:08:57.561026 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Sep 7 13:08:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:58.892197 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:58.893866 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002377 Sep 07 13:08:58.899181 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:59.562209 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-b34de25e-1048-42a0-a959-3af080a3c52e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:59.583159 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-b34de25e-1048-42a0-a959-3af080a3c52e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.545256 Sep 07 13:08:59.583730 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Sep 7 13:08:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:09:00.910530 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:00.912060 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002258 Sep 07 13:09:00.912897 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:09:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:01.803078 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-62a9397f-47fd-421a-bef9-b5c510558c1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:01.824232 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-62a9397f-47fd-421a-bef9-b5c510558c1e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.651075 Sep 07 13:09:01.824796 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Sep 7 13:09:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:09:03.164154 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:03.165517 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001824 Sep 07 13:09:03.166555 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:03.800192 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-00535598-feb3-4f23-987d-f20f39270f1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:03.821896 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-00535598-feb3-4f23-987d-f20f39270f1d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.510926 Sep 07 13:09:03.822466 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Sep 7 13:09:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:09:05.202064 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:05.203580 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001873 Sep 07 13:09:05.204131 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:05.809801 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-9d4218f8-11b2-4b58-9e28-7cdd94968f83 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:05.835484 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-9d4218f8-11b2-4b58-9e28-7cdd94968f83 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.487128 Sep 07 13:09:05.836091 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Wed Sep 7 13:09:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:13.262362 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:13.263839 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ca092671-f347-4b3a-8811-c71bb463ff56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001936 Sep 07 13:10:13.264344 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Wed Sep 7 13:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:13.273750 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:13.744651 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-5a3d4cbd-f4e0-49ca-aba0-1542faf8400a admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:13.768170 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-5a3d4cbd-f4e0-49ca-aba0-1542faf8400a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.495828 Sep 07 13:10:13.768913 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Sep 7 13:10:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:13.791626 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=14 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:13.795802 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-83c0272a-607c-4bca-be55-4b2cdbd58ca0 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:13.804596 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-83c0272a-607c-4bca-be55-4b2cdbd58ca0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014602 Sep 07 13:10:13.805243 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Wed Sep 7 13:10:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:10:13.818571 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-01381712-16ba-4504-9133-058d4ce040b0 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:13.827222 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-01381712-16ba-4504-9133-058d4ce040b0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012218 Sep 07 13:10:13.827806 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Wed Sep 7 13:10:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:13.840606 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:13.849026 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012281 Sep 07 13:10:13.849653 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Wed Sep 7 13:10:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:10:13.863398 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-262c328b-007b-4bd5-85cb-61f9ae48fe5e admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:13.871866 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-262c328b-007b-4bd5-85cb-61f9ae48fe5e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012857 Sep 07 13:10:13.872429 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Wed Sep 7 13:10:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:01.391460 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:01.392497 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 07 13:14:01.392930 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:14:01.541280 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_api:SELECT=6 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:01.710121 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:01.715566 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:01.716058 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:01.716517 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:01.717264 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:01.717724 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:01.718162 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:01.755377 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-b3cc3faa-9615-410c-a836-aa84d7469d50 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.215228 Sep 07 13:14:01.755871 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:14:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:14:02.888615 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:02.889752 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Sep 07 13:14:02.890164 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:03.088276 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:03.091987 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:03.092375 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:03.092795 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:03.093508 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:03.093938 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:03.094499 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:03.115808 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-3f957f19-68f2-49db-ac7d-bfc2af1bbbb0 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.082387 Sep 07 13:14:03.116723 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:14:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:14:14.691555 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:14.692670 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Sep 07 13:14:14.693176 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:14.842660 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_cell0:SELECT=4 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:14.843324 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_cell1:SELECT=4 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:14.843934 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_api:SELECT=8 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:14.895054 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:14.899288 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:14.899761 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:14.900182 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:14.900905 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:14.901345 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:14.901756 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:14.922565 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-ff957334-d802-4f29-adeb-907b12b1bd2b admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.084448 Sep 07 13:14:14.923147 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:14:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:14:16.092605 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:16.093661 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 07 13:14:16.094065 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:14:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:16.299570 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:16.303930 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:16.304414 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:16.304848 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:16.305596 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:16.306057 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:16.306492 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:16.328425 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-cfc0b27a-25ed-4011-ba4a-17b84fa22d8f admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.086558 Sep 07 13:14:16.329024 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:14:16 2022] GET /compute/v2.1/os-services => generated 794 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:14:27.933657 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:27.934726 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 07 13:14:27.935195 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 38/77] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:14:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:14:28.083583 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_cell0:SELECT=4 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:28.084482 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_cell1:SELECT=4 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:28.085291 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG dbcounter [-] [105898] Writing DB stats nova_api:SELECT=8 {{(pid=105898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:28.154663 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:28.158199 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.158682 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.159142 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.159879 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.160347 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.160806 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.187923 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-df329f61-80e1-4d59-b1df-70aa912597e2 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.109969 Sep 07 13:14:28.188514 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 40/78] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:14:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:29.501486 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:29.502870 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-de68f9e7-f55c-415b-840c-a4318edca48c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Sep 07 13:14:29.503319 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 39/79] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Sep 7 13:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:29.736020 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG nova.api.openstack.wsgi [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] Calling method '>' {{(pid=105898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:29.740484 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.741340 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.742522 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.743308 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.743772 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.744245 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: DEBUG oslo_concurrency.lockutils [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.773196 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: INFO nova.api.openstack.requestlog [None req-528ea4b7-e2d0-4141-9349-c8a89e9587cc admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.107337 Sep 07 13:14:29.773781 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: [pid: 105898|app: 0|req: 41/80] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Sep 7 13:14:29 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:15:35.898116 dv-cinder-804035-50-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 13:15:35.899692 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: Wed Sep 7 13:15:35 2022 - graceful shutdown triggered... Sep 07 13:15:35.900210 dv-cinder-804035-50-iscsi devstack@n-api.service[105897]: Gracefully killing worker 1 (pid: 105897)... Sep 07 13:15:35.900586 dv-cinder-804035-50-iscsi devstack@n-api.service[105898]: Gracefully killing worker 2 (pid: 105898)... Sep 07 13:15:36.901032 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: worker 1 buried after 1 seconds Sep 07 13:15:36.901032 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: worker 2 buried after 1 seconds Sep 07 13:15:36.901032 dv-cinder-804035-50-iscsi devstack@n-api.service[105896]: goodbye to uWSGI. Sep 07 13:15:36.902532 dv-cinder-804035-50-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 13:15:36.903303 dv-cinder-804035-50-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 13:15:36.907849 dv-cinder-804035-50-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 13:15:36.921522 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 13:15:36.925573 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 13:15:36 2022] *** Sep 07 13:15:36.925798 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 13:15:36.925936 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 13:15:36.926052 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: nodename: dv-cinder-804035-50-iscsi Sep 07 13:15:36.926163 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: machine: x86_64 Sep 07 13:15:36.926360 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: clock source: unix Sep 07 13:15:36.926478 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: pcre jit disabled Sep 07 13:15:36.926589 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: detected number of CPU cores: 4 Sep 07 13:15:36.926698 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: current working directory: / Sep 07 13:15:36.926816 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: detected binary path: /usr/bin/uwsgi-core Sep 07 13:15:36.926935 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: your processes number limit is 47680 Sep 07 13:15:36.927048 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: your memory page size is 4096 bytes Sep 07 13:15:36.927202 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: detected max file descriptor number: 2048 Sep 07 13:15:36.927355 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: lock engine: pthread robust mutexes Sep 07 13:15:36.928229 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: thunder lock: enabled Sep 07 13:15:36.928606 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 13:15:36.928885 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 13:15:36.977007 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: Python main interpreter initialized at 0x55e2154709c0 Sep 07 13:15:36.977007 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: python threads support enabled Sep 07 13:15:36.977007 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: your server socket listen backlog is limited to 100 connections Sep 07 13:15:36.977007 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: your mercy for graceful operations on workers is 90 seconds Sep 07 13:15:36.977458 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 13:15:36.977458 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: *** Operational MODE: preforking *** Sep 07 13:15:36.977732 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: *** uWSGI is running in multiple interpreter mode *** Sep 07 13:15:36.977732 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: spawned uWSGI master process (pid: 121051) Sep 07 13:15:36.977951 dv-cinder-804035-50-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 13:15:36.978576 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: spawned uWSGI worker 1 (pid: 121069, cores: 1) Sep 07 13:15:36.982555 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: spawned uWSGI worker 2 (pid: 121070, cores: 1) Sep 07 13:15:36.982870 dv-cinder-804035-50-iscsi devstack@n-api.service[121051]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 13:15:37.661512 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:15:37.671778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:15:38.837100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:15:38.837100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: from cryptography.utils import int_from_bytes Sep 07 13:15:38.837772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:15:38.837772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: from cryptography.utils import int_from_bytes Sep 07 13:15:38.874791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:15:38.874791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: from cryptography.utils import int_from_bytes Sep 07 13:15:38.875433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:15:38.875433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: from cryptography.utils import int_from_bytes Sep 07 13:15:41.307947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:15:41.308581 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:15:41.308864 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:15:41.309097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:15:41.309355 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:15:41.309754 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.310080 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.310408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.310731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.311063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.311405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.311731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.312057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.312384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.312645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.312959 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.313489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-50-iscsi {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.313817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.314127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.314442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.314774 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.315083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.315423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.315734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.316242 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.317650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.317650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.317650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.317938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.318260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.318585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.318900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.319232 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.319697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.320012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.320419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-50-iscsi {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.320742 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.321066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.321379 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.321892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.322214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.322536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.322854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.323210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.323505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.323914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.324229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.324595 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.325011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.325011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.325677 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.325677 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.326214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.326214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.326682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.326957 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.327265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.327517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.327767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.328016 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.328349 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.328613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.329416 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.329665 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.330328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.330328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.330821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.331060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.331380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.331620 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.331859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.333171 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.333171 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.333171 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.333171 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.334057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.334057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.334057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.334782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.334782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.335339 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.335339 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.337967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.338870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.338870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.338870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.339622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.339622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.340055 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.340055 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.341724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.341724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.341724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.341724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.341724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.342983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.342983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.342983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.342983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.342983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.345578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.345578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.345578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.345578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.345578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.345578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.347231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.347231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.347231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.347231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.347231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.348631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.348631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.348631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.348631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.349515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.349515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.349515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.350473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.350473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.350473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.351509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.351509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.351509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.351509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.352615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.352615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.352615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.352615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.353515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.353515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.353515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.354978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.355070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:15:41.355070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:15:41.355693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.355693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.355850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:15:41.355941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.356026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:15:41.356118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.356216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:15:41.356352 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.356457 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.356551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.356636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.356725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.356824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.356908 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.357002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.357094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.357185 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.357277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.357362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.357452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.357569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.357867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.357960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.358193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.358296 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.358504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.358606 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.358773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.358870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.359093 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.359218 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.359453 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.359597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-50-iscsi {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.359786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.359927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.360135 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.360272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.360586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.360675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.360910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.361010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.361222 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.361370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.361551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.361800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.361898 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.362134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.362367 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.362480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.362949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.363047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.363302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.363403 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.363619 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.363718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.363962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.364054 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.364286 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.364419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.364594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.364699 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.364916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.365018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.365225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.365317 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.365535 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.365626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.365856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.365956 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.366194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.366284 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-50-iscsi {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.366509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.366607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.366829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.366927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.367180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.367277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.367509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.367624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.367822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.367921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.368133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.368232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.368446 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.368551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.368762 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.368862 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.369071 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.369170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.369406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.369512 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.369722 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.369814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.370044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.370135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.370363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.370464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.370669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.370766 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.370980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.371073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.371312 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.371413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.371620 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.371713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.371957 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.372062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.372289 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.372450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.372544 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.372714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.372806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.373121 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.373425 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.373747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.377307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.377428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.377517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.378314 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.378541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.378631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.378881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.378985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.379061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.379061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.379267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.379267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.379399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.379469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.379539 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.379619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.379698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.379777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.379848 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.380028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.380116 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.380203 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.380322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.380403 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.380476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.380546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.380617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.380769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.380849 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.380921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.380999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.381071 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.381151 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.381237 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.381368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.381468 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.381560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.381733 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.381866 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.381960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.382041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.382135 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.382135 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.382297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.382428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.382505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.382637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.382727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.383359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.383470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.383585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.383673 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.383757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.383848 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.383941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.383941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.384123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.384225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.384311 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.384383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.384460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.384531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.384613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.384712 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.384860 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.384996 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.385166 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.385297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.385556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.385758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.386075 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.386192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.386382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.386618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.386717 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.386801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.386975 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.387135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.387344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.387610 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.387747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.387940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.388098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.388241 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.388402 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.388552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.388726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.388891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.389043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.389186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.389343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.389507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.389707 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.389862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.390013 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.390160 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.390312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.390485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.390654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.390811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.390962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.391151 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.391274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.391436 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.392070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.392229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.392322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.392541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.392661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.392891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.392979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.393208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.393291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.393523 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.393604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.393851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.393950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.394164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.394474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.394587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.394825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.394825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.394992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.395074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.395244 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.395412 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.395504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.395734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.395826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.396041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.400901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.401023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.401111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.401197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.401292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.401390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.401474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.401546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.401634 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.401725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.401809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.401809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.401982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.402066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.402156 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.402246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.402338 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.402434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.402526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.402609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.402688 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.402759 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.402843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.402927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.403017 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.403089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.403179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.403249 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.403337 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.403424 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.403504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.403582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.403653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.403730 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.403813 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.403884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.403954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.404033 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.404123 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.404207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.404375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.404461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.404540 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.404612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:15:41.404682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.404767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.404848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.404848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405092 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405462 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405640 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.405913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406070 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406430 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.406861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.407153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.407251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.407471 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.407564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.407839 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.407930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.408183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.408274 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.408493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.408591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.408798 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.409004 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.409148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411392 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411852 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.411938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.412734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.414499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.414618 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.414707 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.414790 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.414892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.414892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.414892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.415127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.415208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.415514 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.415698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.415835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.416041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.416145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.416379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.416490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.416772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.416870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.417099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.417206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.417416 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.417530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.417732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.417830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.418050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.418156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.418368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.418482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.418687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.418797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.419008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.419173 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.419356 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.419468 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.419669 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.419762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.419985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.420089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.420359 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.420459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.420686 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.420776 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.421002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.421096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.421327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.421418 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.421646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.421918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.422017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.422257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.422362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.422617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.422723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.422939 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.423032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.423311 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.423420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.423638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.423729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.423953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.424041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.424274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.424363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.424589 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.424670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.424917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.425009 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.425227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.425318 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.425579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.425697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.425862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.425959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.426354 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.426465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.426826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.426976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427308 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427397 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427593 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.427923 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.428140 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.428241 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.428456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.428551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.428790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.428884 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.429093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.429185 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.429407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.429499 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.429707 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.429799 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.430031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.430140 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.430340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.430440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.430643 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.430747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.430947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.431061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.431279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.431376 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.431596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.431695 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.431913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.432020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.432244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.432338 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.432562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.432662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.432877 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.433053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.433197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.433349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.433505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.433609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.433836 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.433995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.434136 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.434493 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.434649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.434801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.434972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.435273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.435463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.435622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.435771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.435933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.436089 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.436238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.436387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.436548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.436711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.436864 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.437035 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.437185 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.437345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.437496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.437645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.437808 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.437975 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.438154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.438827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.438992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.439237 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.439425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.439579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.439744 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.439962 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.440165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.440365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.440588 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.440782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.440782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.441151 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.441351 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.441555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.441755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.441942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.442144 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.442329 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.442701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.442893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.443078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.443343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.443547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.443748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.443949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.444212 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.444395 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.444586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.444774 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.444960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.445159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.445361 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.445560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.445751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.445938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.446126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.446329 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.446532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.446733 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.446956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.447388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.447601 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.447815 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.447997 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.448150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.448300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.448452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.448614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.448781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.448943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449815 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449902 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.449996 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450177 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.450962 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.451054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.451174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.451174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.451524 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.451524 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.451790 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.451790 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.452062 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.452284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.452454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.452606 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.452756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.452916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.453064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.453216 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.453379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.453542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.453692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.453891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.454563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.454736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.454888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.455051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.455295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.455464 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.455627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.455803 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.455963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.456112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.456263 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.456471 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.456639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.456803 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.457075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.457270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.457270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.457647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.457837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.458016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.458168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.458317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.458478 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.458644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.458821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.458972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.459154 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.459306 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.459486 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.459636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.459810 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.460053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.460207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.460366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.460563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.460563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.460994 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.461209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.461365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.461515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.461665 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.461828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.461828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.462120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.462280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.462280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.462571 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.462571 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.462875 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.463038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.463332 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.463541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.463770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.464021 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.464189 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.464353 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.464503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.464664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.464827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.465001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.465162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.465373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.465596 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.465753 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.465900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.465900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.466257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.466410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.466572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.466812 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.467039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.467295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.467479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.467697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.467900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.468091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.468302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.468514 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.468681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.468843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.468843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.469144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.469413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.469413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.469699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.469849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.469999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.470159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.470322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.470476 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.470476 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.470751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.470900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.471053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.471269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.471420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.471568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.471718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.471867 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.472094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.472264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.472426 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.472590 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.472741 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.472905 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.473076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.473226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.473376 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.473764 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.473932 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.474077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.474226 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.474527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.474704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.474857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.475019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.475217 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.475388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.475553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.475703 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.475851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.476002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.476165 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.476325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.476485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.476485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.476773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.476938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.477218 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.477379 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.477537 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.477688 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.477898 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.478066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.478285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.478517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.478731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.478908 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.479060 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.479291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.479443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.479594 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.479757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.479931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.480094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.480256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.480407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.480569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.480726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.480879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.481016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.481180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.481340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.481502 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.481668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.481838 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.482067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.482269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.482437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.482598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.482762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.482762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.483051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.483267 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.483429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.483590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.483763 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.483914 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.484064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.484210 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.484360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.484508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.484670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.484819 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.484980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.485171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.485408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.485594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.485760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.485912 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.486061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.486227 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.486378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.486536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.486672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.486818 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.486963 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.487201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.487340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.487817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.488012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.488213 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.488416 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.488606 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.488797 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.488797 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.489181 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.489371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.489571 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.489772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.489985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.490175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.490373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.490565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.490910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.491126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.491369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.491529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.491529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.491529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.491937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.492917 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493160 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493367 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493468 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493570 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493838 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.493930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494866 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.494950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495670 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495763 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.495941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496422 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496513 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496599 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.496953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497132 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497501 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.497944 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498036 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498313 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498398 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498805 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.498918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.499153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.499273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.499451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.499546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.499763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.499872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.500074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.500168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.500385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.500485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.501244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.501458 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.501626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.501753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.501850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.501950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.502153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.502255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.502462 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.502557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.502771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.502880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.503118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.503228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.503437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.503531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.503747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.504034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.504129 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.504349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.504441 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.504668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.504976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.505079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.505173 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.505267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.505355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.505583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.505690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.505899 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.506011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.506210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.506312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.506521 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.506624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.506833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.506937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.507162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.507274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.507494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.507597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.507823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.507924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.508130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.508233 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.508447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.508542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.508756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.508858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.509063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.509157 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.509389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.509484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.509703 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.509811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.510017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.510129 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.510342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.510437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.510665 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.510805 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.510982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.511169 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.511323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.511624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.511757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.511937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.512069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.512250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.512431 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.512556 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.512867 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.513180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.513392 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.513523 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.513719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.513849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.514039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.514169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.514361 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.514506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.514723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.514853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.515040 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.515251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.515386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.515500 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.515706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.515829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.516023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.516159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.516991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.517197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.517313 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.517521 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.517690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.517863 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.518029 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.518195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.518347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.518524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.518661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.518846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.518978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.519198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.519340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.519531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.519649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.519841 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.519943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.520148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.520362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.520457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.520682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.520777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.521001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.521099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.521313 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.521474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.521630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.521795 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.521945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.522110 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.522266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.522544 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.522663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.522751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.522987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.523288 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.523642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.523960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.524286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.524612 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.524931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.525239 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.525564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.525874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.526182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.526500 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.526814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.530503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.530503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.530738 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.530857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.530956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531129 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531222 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531798 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.531981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532158 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532393 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532702 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.532945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.533034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.533126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.533126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.533324 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534286 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534752 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534899 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.534980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.535061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.535172 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.535267 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.535343 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.535423 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.535497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.536594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.536704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.536861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.536938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537009 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537326 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.537959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.539755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.539857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.539945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540029 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540191 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540346 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.540951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.541036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.541116 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.541197 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.541270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.541342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542189 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542286 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542619 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.542927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.544493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.544606 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.544778 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.544864 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.544940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545242 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545722 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545873 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.545945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.546017 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.546098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.546180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.547359 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.547483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.547586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.547675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.547761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.547835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548358 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548664 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.548975 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.549061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.549146 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.549219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.549780 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.549885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.549979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.550055 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.550133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.550206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.550345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.550720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.550872 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.551026 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.551252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.551418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.551580 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.551743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.551897 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.552057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.552238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.552522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.552696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.552869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.553024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.553185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.553339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.553511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.553672 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.553840 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.554479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.554653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.554815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.554969 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.555161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.555324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.555477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.555639 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.555801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.555965 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.555965 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.556273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.556427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.556586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.556860 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.557233 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.557398 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.557572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.557728 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.557880 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.558062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.558309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.558497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.558661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.558823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.558976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.559241 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.559417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.559573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.559726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.559887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.559887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.560185 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.560348 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.560509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.560676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.560829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.560981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.561141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.561308 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.561461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.561614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.561766 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.561934 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.562102 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.562264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.562417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.562569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.562741 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.562894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.563068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.563777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.563934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.564117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.564679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.564843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.565021 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.565177 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.565337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.565491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.565663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.565818 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.565818 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.566119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.566280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.566433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.566594 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.566747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.566998 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.567354 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.567528 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.567691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.567854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.568040 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.568206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.568458 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.568621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.568621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.568920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.569090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.569251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.569412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.569566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.569720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.569720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.569720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570187 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570342 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570655 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.570986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.571696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.571861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.572026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.572193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.572347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.572501 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.572653 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.573022 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.573186 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.573341 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.573502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.573657 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.573825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.574033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.574209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.574384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.574384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.575152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.575328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.575485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.575646 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.575809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.575969 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.576207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.576364 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.576516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.576668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.576841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.577020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.577282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.577646 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.577815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.577815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.578120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.578120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.578467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.578467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.578923 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.579617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.579794 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.579958 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.580118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.580118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.580417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.580574 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.580742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.580906 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.581070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.582398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.582398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.582398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.582398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.582398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.582398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.582398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.583442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.583442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.583442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.583907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.584067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.584285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.585059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.585245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.585504 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.585842 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.586179 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.586684 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.587004 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.587372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.587761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.588006 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.588338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.588675 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.588978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.589294 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.589616 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.589937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.590252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.590571 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.590884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.591250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.591568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.591883 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.592197 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.592516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.592829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.593141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.593453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.593763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.594083 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.594395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.594917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.595410 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.595573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.595840 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.596155 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.596470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.596804 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.597230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.597420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.597934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.598113 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.598380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.598702 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.599030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.599408 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.599823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.600480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.600832 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.601156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.601507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.601848 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.602167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.602485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.602800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.603149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.603476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.603799 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.604120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.604437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.604756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.605244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.605728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.605728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.606023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.606293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.606612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.606932 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.607276 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.607596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.607906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.608310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.608594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.608921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.609244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.609569 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.609896 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.610395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.610782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.611152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.611480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.611824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.612149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.612466 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.613175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.613499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.613827 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.614156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.614631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.614968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.615329 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.615789 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.615968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.616260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.616602 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.616952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.617295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.617626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.617941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.618279 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.618576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.618871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.619230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.619559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.619844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.620156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.620473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.620784 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.621094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.621406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.621717 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.622031 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.622344 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.622651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.622962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.623297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.623610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.623920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.624237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.624548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.624859 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.625167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.625502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.626466 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.626650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.627044 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.627310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.627645 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.628046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.628302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.628685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.628946 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.629350 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.629602 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.629920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.630359 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.631554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.632536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.632887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.633225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.633557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.633887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.634240 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.634585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.634908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.635278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.635664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.635938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.636268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.636778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.636940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.637232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.637557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.637881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.638206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.638526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.638855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.639298 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.639572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.639841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.640168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.640506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.640731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO dbcounter [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Registered counter for database nova_api Sep 07 13:15:41.640898 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.641181 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.642041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.642384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.651934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.652679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.653297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.653885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.654455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.655007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.655600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:15:41.656123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:15:41.664180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_db.sqlalchemy.engines [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:41.671740 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writer thread running {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:41.723351 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO dbcounter [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Registered counter for database nova_api Sep 07 13:15:41.731465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.context [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03b1f7e0-85a9-4e40-963d-59c98178354b(cell1) {{(pid=121070) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:15:41.736093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.736578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.738481 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.739236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.739696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.741943 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.744076 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO dbcounter [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Registered counter for database nova_cell0 Sep 07 13:15:41.745008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_db.sqlalchemy.engines [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:41.748302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO dbcounter [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Registered counter for database nova_cell1 Sep 07 13:15:41.752585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writer thread running {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:41.756895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_db.sqlalchemy.engines [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:41.758021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_db.sqlalchemy.engines [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:41.765426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writer thread running {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:41.766789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writer thread running {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:41.814937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.context [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03b1f7e0-85a9-4e40-963d-59c98178354b(cell1) {{(pid=121069) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:15:41.819018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.819528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.821148 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.821870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.822323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.824439 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.826407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO dbcounter [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Registered counter for database nova_cell0 Sep 07 13:15:41.830511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO dbcounter [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Registered counter for database nova_cell1 Sep 07 13:15:41.839780 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_db.sqlalchemy.engines [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:41.840903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_db.sqlalchemy.engines [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:41.848856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writer thread running {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:41.849211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writer thread running {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:41.918707 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO dbcounter [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Registered counter for database nova_cell0 Sep 07 13:15:41.926163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_db.sqlalchemy.engines [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:41.931052 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writer thread running {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:41.998541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO dbcounter [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Registered counter for database nova_cell0 Sep 07 13:15:42.006641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_db.sqlalchemy.engines [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:15:42.011839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writer thread running {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:15:42.277504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: WARNING keystonemiddleware.auth_token [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:15:42.285572 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: WARNING keystonemiddleware.auth_token [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:15:42.338914 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: WARNING keystonemiddleware.auth_token [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:15:42.347010 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: WARNING keystonemiddleware.auth_token [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:15:42.709609 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: WARNING keystonemiddleware.auth_token [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:15:42.713764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: WARNING keystonemiddleware.auth_token [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:15:42.716200 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: WARNING keystonemiddleware.auth_token [None req-e0dff0eb-c1f7-42b8-be27-025016dad793 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:15:42.721603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: WARNING keystonemiddleware.auth_token [None req-45fa2d87-5435-4e90-99d8-bc6da1cac980 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:15:42.723573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e2154709c0 pid: 121070 (default app) Sep 07 13:15:42.727089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e2154709c0 pid: 121069 (default app) Sep 07 13:16:21.306617 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:21.307671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:21.310494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:21.312986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bf79c1ea-5586-4f5a-87fd-cfc1fbec1927 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Action: 'create', calling method: .version_select at 0x7fa3dc6a4430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-794594199", "metadata": {"Type": "work"}}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bf79c1ea-5586-4f5a-87fd-cfc1fbec1927 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Request method failure captured: Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 121 Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJmllrKyuzMzxmo447Pn7c_A_pLaK-xfYe9sX1MEo0ccz3gGaYMTce-c913b512fqMUacDYKmnXh6ZmWsLo9TLpYZkwFMMNGTwqdm3PabEN5F7uSpLVs6Cq5BLvFGEs6thSzvpxIRGytStDKFQGdgM2Q8KbU2vVuYbmIl-XnROKdiYg Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:16:22.748568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/267fd08403b049f0b6464921bc8fa2f3"}]}] Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: cc2142713d524f4da090c4fc72b25db9 Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-794594199", "metadata": {"Type": "work"}}} Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: Sep 07 13:16:22.760533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-794594199', 'metadata': {'Type': 'work'}}}} Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:22.763077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:16:22.765991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:16:22.767008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:16:22.767008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:22.767008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bf79c1ea-5586-4f5a-87fd-cfc1fbec1927 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:22.767008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bf79c1ea-5586-4f5a-87fd-cfc1fbec1927 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.449876 Sep 07 13:16:22.767008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Sep 7 13:16:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1454 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:16:22.767334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:22.767334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:22.767334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:22.767334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:23.320108 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b935e939-f5f6-47da-8aaa-1e04b4526f1b tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Action: 'create', calling method: .version_select at 0x7fa3dc761940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1299987249", "metadata": {"Type": "work"}}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b935e939-f5f6-47da-8aaa-1e04b4526f1b tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Request method failure captured: Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 120 Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJmllrKyuzMzxmo447Pn7c_A_pLaK-xfYe9sX1MEo0ccz3gGaYMTce-c913b512fqMUacDYKmnXh6ZmWsLo9TLpYZkwFMMNGTwqdm3PabEN5F7uSpLVs6Cq5BLvFGEs6thSzvpxIRGytStDKFQGdgM2Q8KbU2vVuYbmIl-XnROKdiYg Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:16:23.339722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/267fd08403b049f0b6464921bc8fa2f3"}]}] Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: cc2142713d524f4da090c4fc72b25db9 Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1299987249", "metadata": {"Type": "work"}}} Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: Sep 07 13:16:23.340760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1299987249', 'metadata': {'Type': 'work'}}}} Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi '0' Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:23.341358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:16:23.343478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:16:23.344552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:16:23.344552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.349783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b935e939-f5f6-47da-8aaa-1e04b4526f1b tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:23.353208 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b935e939-f5f6-47da-8aaa-1e04b4526f1b tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.613089 Sep 07 13:16:23.359348 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 1/2] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Sep 7 13:16:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 620 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:16:23.366723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-abca42ad-d34c-48f1-8edd-d0bc87a789c6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Action: 'create', calling method: .version_select at 0x7fa3dc6a4d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-193200709", "metadata": {"Type": "work"}}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-abca42ad-d34c-48f1-8edd-d0bc87a789c6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Request method failure captured: Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 118 Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJmllrKyuzMzxmo447Pn7c_A_pLaK-xfYe9sX1MEo0ccz3gGaYMTce-c913b512fqMUacDYKmnXh6ZmWsLo9TLpYZkwFMMNGTwqdm3PabEN5F7uSpLVs6Cq5BLvFGEs6thSzvpxIRGytStDKFQGdgM2Q8KbU2vVuYbmIl-XnROKdiYg Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:16:23.377213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/267fd08403b049f0b6464921bc8fa2f3"}]}] Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: cc2142713d524f4da090c4fc72b25db9 Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-193200709", "metadata": {"Type": "work"}}} Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: Sep 07 13:16:23.378575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-193200709', 'metadata': {'Type': 'work'}}}} Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi '' Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:23.379435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:16:23.380796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:16:23.381874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:16:23.381874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:23.385671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-abca42ad-d34c-48f1-8edd-d0bc87a789c6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:23.388583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-abca42ad-d34c-48f1-8edd-d0bc87a789c6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027605 Sep 07 13:16:23.392100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Sep 7 13:16:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:16:23.404124 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f7955d6-c072-46b8-b512-6c6115e06a32 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Calling method '.version_select at 0x7fa3dc700ca0>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:24.140051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-6f7955d6-c072-46b8-b512-6c6115e06a32 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] HTTP exception thrown: Volume tempest-invalid-266352988 could not be found. Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f7955d6-c072-46b8-b512-6c6115e06a32 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Request method failure captured: Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-266352988 HTTP/1.1 Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJmllrKyuzMzxmo447Pn7c_A_pLaK-xfYe9sX1MEo0ccz3gGaYMTce-c913b512fqMUacDYKmnXh6ZmWsLo9TLpYZkwFMMNGTwqdm3PabEN5F7uSpLVs6Cq5BLvFGEs6thSzvpxIRGytStDKFQGdgM2Q8KbU2vVuYbmIl-XnROKdiYg Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:16:24.144875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/267fd08403b049f0b6464921bc8fa2f3"}]}] Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: cc2142713d524f4da090c4fc72b25db9 Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Volume tempest-invalid-266352988 could not be found. Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'tempest-invalid-266352988'} Sep 07 13:16:24.146111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-266352988 could not be found. (HTTP 404) (Request-ID: req-122f4142-12a0-4c80-a38c-0a7c2a671b99) Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.146777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:16:24.147788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-266352988 could not be found. Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:16:24.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-266352988 could not be found. Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-266352988 could not be found. Sep 07 13:16:24.149659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.153433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f7955d6-c072-46b8-b512-6c6115e06a32 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Returning 404 to user: Volume tempest-invalid-266352988 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:24.154881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6f7955d6-c072-46b8-b512-6c6115e06a32 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-266352988" status: 404 len: 98 microversion: 2.1 time: 0.756921 Sep 07 13:16:24.156506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1215 bytes} [Wed Sep 7 13:16:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-266352988 => generated 98 bytes in 759 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:16:24.165950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-22c74f61-e5f8-471f-bd57-a5132227b0a5 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003727 Sep 07 13:16:24.166692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1140 bytes} [Wed Sep 7 13:16:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 13:16:24.177226 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e73ae028-acff-464a-bf6f-cd69884681fd tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004529 Sep 07 13:16:24.179882 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 3/6] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Sep 7 13:16:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 13:16:24.200777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-786f0d6e-679d-4e4b-acff-aea620a0ab6c tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Calling method '.version_select at 0x7fa3dc5613a0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:24.556376 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-786f0d6e-679d-4e4b-acff-aea620a0ab6c tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] HTTP exception thrown: Volume 18dde6b0-251e-4f0a-bebc-304970022adf could not be found. Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-786f0d6e-679d-4e4b-acff-aea620a0ab6c tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Request method failure captured: Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: DELETE /compute/v2.1/os-volumes/18dde6b0-251e-4f0a-bebc-304970022adf HTTP/1.1 Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJmllrKyuzMzxmo447Pn7c_A_pLaK-xfYe9sX1MEo0ccz3gGaYMTce-c913b512fqMUacDYKmnXh6ZmWsLo9TLpYZkwFMMNGTwqdm3PabEN5F7uSpLVs6Cq5BLvFGEs6thSzvpxIRGytStDKFQGdgM2Q8KbU2vVuYbmIl-XnROKdiYg Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:16:24.597021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/267fd08403b049f0b6464921bc8fa2f3"}]}] Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: cc2142713d524f4da090c4fc72b25db9 Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Volume 18dde6b0-251e-4f0a-bebc-304970022adf could not be found. Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '18dde6b0-251e-4f0a-bebc-304970022adf'} Sep 07 13:16:24.599291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18dde6b0-251e-4f0a-bebc-304970022adf could not be found. (HTTP 404) (Request-ID: req-1a08c770-80ad-40c4-9ea2-43790180eb39) Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.602061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:16:24.604064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18dde6b0-251e-4f0a-bebc-304970022adf could not be found. Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:16:24.606044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18dde6b0-251e-4f0a-bebc-304970022adf could not be found. Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18dde6b0-251e-4f0a-bebc-304970022adf could not be found. Sep 07 13:16:24.608152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.612477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-786f0d6e-679d-4e4b-acff-aea620a0ab6c tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Returning 404 to user: Volume 18dde6b0-251e-4f0a-bebc-304970022adf could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:24.616158 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-786f0d6e-679d-4e4b-acff-aea620a0ab6c tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/18dde6b0-251e-4f0a-bebc-304970022adf" status: 404 len: 109 microversion: 2.1 time: 0.430844 Sep 07 13:16:24.624537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:16:24 2022] DELETE /compute/v2.1/os-volumes/18dde6b0-251e-4f0a-bebc-304970022adf => generated 109 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:16:24.637496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d7c72e48-6ab3-44e9-883c-d089243cabf6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Calling method '.version_select at 0x7fa3dc4e3a60>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:24.696975 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-d7c72e48-6ab3-44e9-883c-d089243cabf6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] HTTP exception thrown: Volume ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 could not be found. Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d7c72e48-6ab3-44e9-883c-d089243cabf6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Request method failure captured: Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/os-volumes/ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 HTTP/1.1 Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJmllrKyuzMzxmo447Pn7c_A_pLaK-xfYe9sX1MEo0ccz3gGaYMTce-c913b512fqMUacDYKmnXh6ZmWsLo9TLpYZkwFMMNGTwqdm3PabEN5F7uSpLVs6Cq5BLvFGEs6thSzvpxIRGytStDKFQGdgM2Q8KbU2vVuYbmIl-XnROKdiYg Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:16:24.700127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/267fd08403b049f0b6464921bc8fa2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/267fd08403b049f0b6464921bc8fa2f3"}]}] Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 267fd08403b049f0b6464921bc8fa2f3 Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesNegativeTest-1624094523 Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: cc2142713d524f4da090c4fc72b25db9 Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesNegativeTest-1624094523-project Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Volume ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 could not be found. Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'ddb1a1ab-10f1-4691-85b7-623fb8bd9e53'} Sep 07 13:16:24.701945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 could not be found. (HTTP 404) (Request-ID: req-dea1920a-ad72-4d0f-a354-9bcba2f4bcce) Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.702623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:16:24.703639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 could not be found. Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:16:24.705531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 could not be found. Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 could not be found. Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:16:24.706550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d7c72e48-6ab3-44e9-883c-d089243cabf6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] Returning 404 to user: Volume ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:24.707782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d7c72e48-6ab3-44e9-883c-d089243cabf6 tempest-VolumesNegativeTest-1624094523 tempest-VolumesNegativeTest-1624094523-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ddb1a1ab-10f1-4691-85b7-623fb8bd9e53" status: 404 len: 109 microversion: 2.1 time: 0.080694 Sep 07 13:16:24.708512 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:16:24 2022] GET /compute/v2.1/os-volumes/ddb1a1ab-10f1-4691-85b7-623fb8bd9e53 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:16:29.652584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6848adde-3637-465d-bc66-a60bae84babc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'create', calling method: .version_select at 0x7fa3dc4e8dc0>, body: {"keypair": {"name": "tempest-keypair-1440509267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3gU392TqY7ZDB8q/Ik5ByGbkQ4N6Q62z1XxYm+iFRi/AwmN3uipyLUW/H0GQb2aG6cCu7jgt43NKSz2aZmMzGqPNQ430jmmXOihrx1tuE5aiPSQgWs37boImpVBJIMGg=="}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:29.725834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-6848adde-3637-465d-bc66-a60bae84babc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:29.739578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-6848adde-3637-465d-bc66-a60bae84babc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for user 181c888fbd454f00b049522fdfb4197e and project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:29.852377 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6848adde-3637-465d-bc66-a60bae84babc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.442948 Sep 07 13:16:29.853397 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 5/9] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Sep 7 13:16:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 446 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 13:16:38.854628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1671110464", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b34adbe1-953c-4c08-8e5b-71fafd005b90"}], "security_groups": [{"name": "tempest-securitygroup--554343616"}], "key_name": "tempest-keypair-1440509267", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:38.998693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-134834517", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "networks": [{"uuid": "e0a6ec3a-61ee-4039-b6eb-38424df94963"}]}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:39.290617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] validate_networks() for [('e0a6ec3a-61ee-4039-b6eb-38424df94963', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:39.769391 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=4 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:40.702874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] validate_networks() for [('b34adbe1-953c-4c08-8e5b-71fafd005b90', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:41.786631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:41.788060 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:41.788791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:41.789396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:41.790032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:41.836918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:41.838304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:41.840074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:41.841917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:41.842669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:41.845066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:41.944107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Getting quotas for project d43169ae236d4341abb683010449c5e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:41.957870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Getting quotas for user cf718a19fbc9458c996678ed7accc344 and project d43169ae236d4341abb683010449c5e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:41.999161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:42.003839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:42.208065 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4e28dd40-0f56-4367-9d05-4ad73feeacba tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.685801 Sep 07 13:16:42.212255 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 5/10] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:16:42.240573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8fd2b460-e575-4c00-b7c6-1c47756c8b6a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:42.253568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8fd2b460-e575-4c00-b7c6-1c47756c8b6a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:42.505886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8fd2b460-e575-4c00-b7c6-1c47756c8b6a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:42.545551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8fd2b460-e575-4c00-b7c6-1c47756c8b6a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1214 microversion: 2.1 time: 0.318539 Sep 07 13:16:42.554652 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:42 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:43.348963 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:43.349469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:43.349805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:43.350225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:43.350636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:43.362803 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:43.364039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:43.364662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:43.365782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:43.367673 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:43.369909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:43.480487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:43.487953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for user 181c888fbd454f00b049522fdfb4197e and project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:43.505783 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:43.535319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:43.579823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-06c29db2-ab2e-4b7c-8068-1d1b7594f6e1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:43.583959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-06c29db2-ab2e-4b7c-8068-1d1b7594f6e1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:43.834142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-06c29db2-ab2e-4b7c-8068-1d1b7594f6e1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:43.848622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-06c29db2-ab2e-4b7c-8068-1d1b7594f6e1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1214 microversion: 2.1 time: 0.274858 Sep 07 13:16:43.850070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 7/12] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:43 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1214 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:43.870041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e94ba629-8635-4666-b62a-a1d81783f870 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.027695 Sep 07 13:16:43.872545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 6/13] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Sep 7 13:16:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 5033 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 13:16:43.903875 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-dfba354c-e1ea-4dd5-b9c4-43a5d54e31fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:43.904717 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-dfba354c-e1ea-4dd5-b9c4-43a5d54e31fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:44.228124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dfba354c-e1ea-4dd5-b9c4-43a5d54e31fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:44.299550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dfba354c-e1ea-4dd5-b9c4-43a5d54e31fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:44.311335 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dfba354c-e1ea-4dd5-b9c4-43a5d54e31fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:44.320133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-dfba354c-e1ea-4dd5-b9c4-43a5d54e31fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1282 microversion: 2.20 time: 0.430274 Sep 07 13:16:44.321953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 7/14] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:43 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1282 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:44.911333 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f8fa0cd2-0022-49bf-b9db-677357a0e2f0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:44.922143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f8fa0cd2-0022-49bf-b9db-677357a0e2f0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:45.038059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3215d75f-d434-414f-9a8f-0e7a76aba208 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'create', calling method: .version_select at 0x7fa3dbb4b040>, body: {"keypair": {"name": "tempest-keypair-747772173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOXKQivn8FJB61HqbWd1gFckKyEfeteTGrKNjpUMtUDQXEf9YiiRFsUBNFEPON/Co1JkTTVO2gjhkJJdWlNGeqzm2DhPojloOLunOvlb6ySSKYaI46E9hILzOjvVPDNmg=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:45.176714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-3215d75f-d434-414f-9a8f-0e7a76aba208 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for project ccb52045ffa14e94998e764c1dbc605e. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:45.192008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-3215d75f-d434-414f-9a8f-0e7a76aba208 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for user b55eed583fac43fb9bfe1366a42bd2fc and project ccb52045ffa14e94998e764c1dbc605e. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:45.269645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f8fa0cd2-0022-49bf-b9db-677357a0e2f0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:45.297409 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f8fa0cd2-0022-49bf-b9db-677357a0e2f0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1214 microversion: 2.1 time: 0.391438 Sep 07 13:16:45.299471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3215d75f-d434-414f-9a8f-0e7a76aba208 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.444794 Sep 07 13:16:45.309104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 8/15] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:16:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:45.325809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:44 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1214 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:45.375495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e72c9908-3758-4e87-baa4-ae3cec507835 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:45.376328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e72c9908-3758-4e87-baa4-ae3cec507835 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:45.790250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e72c9908-3758-4e87-baa4-ae3cec507835 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:45.808261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e72c9908-3758-4e87-baa4-ae3cec507835 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:45.818576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e72c9908-3758-4e87-baa4-ae3cec507835 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:45.822669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e72c9908-3758-4e87-baa4-ae3cec507835 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1282 microversion: 2.20 time: 0.452759 Sep 07 13:16:45.840562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 9/17] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:45 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1282 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:46.349278 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:46.355043 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:46.389494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:46.390004 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:46.390453 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:46.391186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:46.399531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:46.411738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:46.965985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:46.985885 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-20e09ca6-2115-454b-8eec-237de8691062 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1266 microversion: 2.1 time: 0.654229 Sep 07 13:16:47.000485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 9/18] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:46 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:47.029583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:47.040079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:47.068261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.069014 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.069735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:47.070636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.071621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.071736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:47.123688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-579919576", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:47.258087 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] validate_networks() for [('38cbb300-e142-4750-9bd8-b00f8ec9be1d', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:47.305083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:47.316996 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:47.321833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:47.332561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2d16e9b5-0999-442c-b959-e0eb8329fee6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1278 microversion: 2.20 time: 0.321048 Sep 07 13:16:47.334448 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 10/19] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:47 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:48.026260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:48.027030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:48.062420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:48.063183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:48.063647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:48.064490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:48.072650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:48.077063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:48.402325 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:48.421464 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-70ad946c-07c5-4a06-9d20-57d3220bbcd8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1272 microversion: 2.1 time: 0.395058 Sep 07 13:16:48.422822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 11/20] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:48 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1272 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:48.444208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:48.445141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:48.469691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:48.471213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:48.473498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:48.476410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:48.479578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:48.481519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.271573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.301755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.310402 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.328064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fa96c460-b50c-4559-82b5-ab5e9fdbd0d2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1334 microversion: 2.20 time: 0.901274 Sep 07 13:16:49.335549 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 12/21] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:48 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1334 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:49.373304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:49.373821 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:49.374174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:49.374582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:49.374998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:49.397246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.397747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.398190 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.398965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.399527 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.399927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.451953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:49.453777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:49.455333 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:49.462345 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for user 406bdf61f9284ebc8620b21ee414ec91 and project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:49.468048 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.469832 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.471199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.475667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.479037 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.482487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.513993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:49.524324 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:49.695621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.710652 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0b0cd382-e836-400e-9389-60b7d84ad584 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1272 microversion: 2.1 time: 0.262967 Sep 07 13:16:49.712780 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 13/22] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:49 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:49.732610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-76496ce7-f2bd-42c7-8fe4-bfa37c0ed2c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.041828 Sep 07 13:16:49.734036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 10/23] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:16:49.747743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-47b1267c-1dd0-4270-8d9e-37bc54d37e36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:49.748371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-47b1267c-1dd0-4270-8d9e-37bc54d37e36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:49.895503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-47b1267c-1dd0-4270-8d9e-37bc54d37e36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.913035 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-47b1267c-1dd0-4270-8d9e-37bc54d37e36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1221 microversion: 2.1 time: 0.170678 Sep 07 13:16:49.919676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 14/24] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:49 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:50.363944 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:50.364567 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:50.389787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:50.394497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:50.395084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:50.396135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:50.396931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:50.399913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:50.414009 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-371990337", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:50.674740 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] validate_networks() for [('38cbb300-e142-4750-9bd8-b00f8ec9be1d', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:51.486147 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:51.575530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:51.578452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:51.604688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-84619c5d-55c3-4541-9458-66aff4fc3c3b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1340 microversion: 2.20 time: 1.237454 Sep 07 13:16:51.632385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 11/25] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:50 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1340 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:51.676453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:51.682983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:51.760878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.761699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.763086 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:51.776637 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.787555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.791548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.103006 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.119890 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-711c326f-cff0-4083-9f63-0552c5814090 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 1.475592 Sep 07 13:16:53.136869 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 12/26] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:51 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:53.152884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:53.155406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:53.162713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.163490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.164092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.165000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.165594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.166228 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.448846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:53.516912 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.561970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.571174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.587062 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-404bed54-4d32-44cc-a711-aada9a2b230d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1340 microversion: 2.20 time: 0.442166 Sep 07 13:16:53.597332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 13/27] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:53 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1340 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:53.638483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:53.640174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:53.641115 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:53.641895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:53.647631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:53.668363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:53.739206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.751349 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.752115 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.755727 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.756942 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.757635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.806871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:53.825687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for user 406bdf61f9284ebc8620b21ee414ec91 and project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:53.870700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:53.877595 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:54.062922 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-604cfa3f-aeee-49a2-a490-486e8fbdce39 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.653107 Sep 07 13:16:54.082423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 15/28] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:16:54.095706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d9ec6724-d67a-450d-95fc-400f0232dba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:54.097767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d9ec6724-d67a-450d-95fc-400f0232dba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:54.169327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:54.171972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:54.222884 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.227726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.230155 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.232938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.256228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.257907 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.274718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d9ec6724-d67a-450d-95fc-400f0232dba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.286582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d9ec6724-d67a-450d-95fc-400f0232dba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1221 microversion: 2.1 time: 0.205277 Sep 07 13:16:54.290357 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 14/29] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:54 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:54.622380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:54.623207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:54.653633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.653633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.653990 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.654753 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.655639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.655639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.878970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.892533 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.898629 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.909230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dc3102be-c87a-40cf-afde-68eb948faaaa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1340 microversion: 2.20 time: 0.282604 Sep 07 13:16:54.909230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 15/30] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:54 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1340 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:54.921883 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.935281 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a94997ad-cace-46c8-bd06-49e61eb063e0 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.784920 Sep 07 13:16:54.945656 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 16/31] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:54 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:55.316305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e499206f-f344-4f9f-8481-65eaea450e8f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:55.318157 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e499206f-f344-4f9f-8481-65eaea450e8f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:55.594231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e499206f-f344-4f9f-8481-65eaea450e8f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:55.611864 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e499206f-f344-4f9f-8481-65eaea450e8f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1221 microversion: 2.1 time: 0.295905 Sep 07 13:16:55.615733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 16/32] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:55 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1221 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:55.932797 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:55.934153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:55.946638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:55.950455 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:55.951028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:55.952228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:55.958212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:55.959069 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:55.962639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:55.963305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:55.975951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:55.978288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:55.982404 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:55.984012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:55.984742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:55.985740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.421894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.433749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.439642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.450636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bd82f4f1-ef05-4443-870b-78b74c33e18a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1340 microversion: 2.20 time: 0.521530 Sep 07 13:16:56.451366 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 17/33] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:55 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1340 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:56.545712 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1662532948", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf36dea6-842d-4d1e-bd77-9da1f9f07b62"}], "security_groups": [{"name": "tempest-securitygroup--1986085976"}], "key_name": "tempest-keypair-747772173", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:57.080394 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:57.105541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3601eefa-46c9-4b9b-9207-523fdc8b856d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 1.137069 Sep 07 13:16:57.106275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 17/34] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:55 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:57.129401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:57.130105 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:57.163643 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.164242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.165330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.170476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.172830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.173886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.772437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:57.787216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fe8bfbcd-c1f4-4fd7-8c90-96dd949722b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1273 microversion: 2.1 time: 0.679800 Sep 07 13:16:57.787924 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 18/35] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:57 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1273 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:57.803688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:57.807321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:57.830972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.832421 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.836993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.838244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.840160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.845866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] validate_networks() for [('cf36dea6-842d-4d1e-bd77-9da1f9f07b62', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:57.851590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:59.189863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:59.201077 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:59.202627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:59.244041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e7222f6b-84ec-4904-8462-601080d4f0fb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 1.445624 Sep 07 13:16:59.259949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 19/36] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:57 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:59.274273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:59.275012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:59.309016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:59.316159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:59.316675 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:59.317564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:59.318435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:59.323495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:59.435643 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=4 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:00.349321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:00.365630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b174937b-0607-4680-80c8-e2e0b49efa5d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 1.104271 Sep 07 13:17:00.368341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 20/37] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:59 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:00.380809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:00.381432 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:00.403091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.403999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.405131 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.408117 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.411494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.414372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.609740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:00.628204 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-82a90905-66be-4568-8863-2aa1196925c7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.258055 Sep 07 13:17:00.630055 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 21/38] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:00 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:00.652127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:00.652787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:00.664546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.665043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.665483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.666207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.666660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.667085 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.946341 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:17:00.947096 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:17:00.950010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:17:00.957751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:17:00.959337 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:17:00.991890 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.992629 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.994322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.997477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.998201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.999720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.060378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for project ccb52045ffa14e94998e764c1dbc605e. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:01.070275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for user b55eed583fac43fb9bfe1366a42bd2fc and project ccb52045ffa14e94998e764c1dbc605e. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:01.093760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:17:01.096400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:17:01.098550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.109565 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.115018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.118086 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-774cb569-4611-49ea-b5f2-209ec7721fe6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.484792 Sep 07 13:17:01.119277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 22/39] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:00 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:01.222644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bff17981-7b84-4ed1-ae0b-2c3ed4fa9d79 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.681668 Sep 07 13:17:01.223702 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 18/40] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 4683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:17:01.245134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6ec20df8-10ed-4067-ba54-6c298c0e4670 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:01.247876 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6ec20df8-10ed-4067-ba54-6c298c0e4670 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:01.258122 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-6b925d69-5173-4d8d-af9d-9541cca60e44 req-9d34ed88-4df3-423a-b044-631ee03a6a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa967676-e023-44fe-af50-47db2225c4c5", "tag": "d09ff3be-283a-4f61-92b6-2a7fe58192db"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:01.274542 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b925d69-5173-4d8d-af9d-9541cca60e44 req-9d34ed88-4df3-423a-b044-631ee03a6a23 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.275092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b925d69-5173-4d8d-af9d-9541cca60e44 req-9d34ed88-4df3-423a-b044-631ee03a6a23 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.275650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b925d69-5173-4d8d-af9d-9541cca60e44 req-9d34ed88-4df3-423a-b044-631ee03a6a23 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.302660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-6b925d69-5173-4d8d-af9d-9541cca60e44 req-9d34ed88-4df3-423a-b044-631ee03a6a23 service nova] Creating event network-changed:d09ff3be-283a-4f61-92b6-2a7fe58192db for instance aa967676-e023-44fe-af50-47db2225c4c5 on hv-cinder-80403 Sep 07 13:17:01.303417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b925d69-5173-4d8d-af9d-9541cca60e44 req-9d34ed88-4df3-423a-b044-631ee03a6a23 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:17:01.304217 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b925d69-5173-4d8d-af9d-9541cca60e44 req-9d34ed88-4df3-423a-b044-631ee03a6a23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:17:01.306019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.306704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.307398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.308462 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.309141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.319669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.335000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.compute.rpcapi [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:17:01.336636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] Releasing lock "compute-rpcapi-router" {{(pid=121069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:17:01.349614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6ec20df8-10ed-4067-ba54-6c298c0e4670 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.358219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-54ceb065-4ab3-479c-8010-a98c4cd24e58 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187920 Sep 07 13:17:01.359693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 23/41] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:17:01.362065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6ec20df8-10ed-4067-ba54-6c298c0e4670 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1237 microversion: 2.1 time: 0.126865 Sep 07 13:17:01.376498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 19/42] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:01 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:01.395375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:01.396650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:01.407661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.408622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.409057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.409851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.410217 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.410648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.432018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-b9cb794b-85ac-4340-bdd9-4ed619b74f48 req-27bb7c7d-297e-40bb-a436-b70cdca44b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e020bf09-5375-498a-b72c-4467376b0b7c", "tag": "2e0f07aa-fa54-42a6-98a3-af1a44859d05"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:01.442946 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b9cb794b-85ac-4340-bdd9-4ed619b74f48 req-27bb7c7d-297e-40bb-a436-b70cdca44b84 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.443563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b9cb794b-85ac-4340-bdd9-4ed619b74f48 req-27bb7c7d-297e-40bb-a436-b70cdca44b84 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.444070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b9cb794b-85ac-4340-bdd9-4ed619b74f48 req-27bb7c7d-297e-40bb-a436-b70cdca44b84 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.455910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-b9cb794b-85ac-4340-bdd9-4ed619b74f48 req-27bb7c7d-297e-40bb-a436-b70cdca44b84 service nova] Creating event network-changed:2e0f07aa-fa54-42a6-98a3-af1a44859d05 for instance e020bf09-5375-498a-b72c-4467376b0b7c on hv-cinder-80403 Sep 07 13:17:01.462903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-b9cb794b-85ac-4340-bdd9-4ed619b74f48 req-27bb7c7d-297e-40bb-a436-b70cdca44b84 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101070 Sep 07 13:17:01.464018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 24/43] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:01.564662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.574892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6c3f6724-b521-456e-acdb-b5a9ee3f5e69 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.189329 Sep 07 13:17:01.575916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 20/44] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:01 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:01.662316 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:01.663074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:01.669844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.670330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.671490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.673169 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.674170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.674951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.775943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.785546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d6c2da17-2832-4973-9c2b-8281de3fc141 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.128542 Sep 07 13:17:01.786164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 25/45] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:01 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:02.145687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.146303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.152664 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.153155 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.153587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.154289 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.154747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.155211 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.298085 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:02.313564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:02.316536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:02.318691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-dff5c410-d6e4-4d5f-abd2-8da9e894fc66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.176672 Sep 07 13:17:02.320106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 21/46] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:02 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:02.386800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.387454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.394020 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.394509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.394947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.395699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.396155 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.396581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.484044 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:02.491885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fc24ed18-2e94-4b85-b40e-8dd16e856a27 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1241 microversion: 2.1 time: 0.109704 Sep 07 13:17:02.492456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 26/47] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:02 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:02.601782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.602389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.608821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.609318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.610981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.610981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.611221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.611606 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.759057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:02.768065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5763330e-0b71-40cb-bc91-8581a6a2cdc2 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.170037 Sep 07 13:17:02.768599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 22/48] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:02 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:02.814136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.815030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.821825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.822317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.822755 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.824358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.825068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.826596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.898792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:02.907629 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-034bee38-b27c-4a64-bab1-5aca99866edf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.097797 Sep 07 13:17:02.908971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 27/49] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:02 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:03.345714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:03.347356 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:03.354215 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.355421 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.356095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.356901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.357418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.357928 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.517706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:03.518715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:03.529208 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.530182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.530749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.531822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.532501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.532950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.635377 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.652063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.656972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.657524 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.660553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f247633d-83e5-48b2-9696-a02a8a94e8ce tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.319018 Sep 07 13:17:03.667189 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 23/50] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:03 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:03.684387 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b137a59e-39b2-47d6-8e19-b6aae29fea01 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1241 microversion: 2.1 time: 0.173035 Sep 07 13:17:03.695167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 28/51] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:03 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:03.797263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:03.798047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:03.805500 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.806412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.806680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.807314 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.807949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.808528 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.932304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:03.933301 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:03.943252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.944097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.944778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.945763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.946301 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.946955 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.977938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.993236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-71051577-5cc4-4bc6-af98-f662bc753524 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.202306 Sep 07 13:17:03.994668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 24/52] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:03 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:04.027400 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.031034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:04.036744 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4de4f6fd-3e55-4acc-a2f4-93e8c3fa8f53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.108781 Sep 07 13:17:04.037349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 29/53] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:03 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:04.693183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:04.693897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:04.700629 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.701122 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.701559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.702266 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.702719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.703181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.717748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:04.718594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:04.722641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:04.731963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.732933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.733613 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.734624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.735592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.736245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.813314 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.829716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-373d0dd1-c7fb-4ace-96e3-9e5f8db354ac tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1241 microversion: 2.1 time: 0.116388 Sep 07 13:17:04.831144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 30/54] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:04 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:04.878058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.887297 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.888775 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.890334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1344a9a0-babc-4d19-9cb2-2c2d54e9f22f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.202942 Sep 07 13:17:04.890975 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 25/55] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:04 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:05.029323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:05.029853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:05.036291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.036791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.037270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.038009 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.038474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.038905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.063179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:05.064866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:05.095677 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.096505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.097069 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.097850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.098377 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.098896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.185566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:05.193827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-284ee24c-1e0c-4b07-bf5c-0171a5c11d7c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.138438 Sep 07 13:17:05.194413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 26/56] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:05 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:05.251232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:05.259414 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9e4c902f-78da-4773-ae2e-39605683e636 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.235344 Sep 07 13:17:05.259999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 31/57] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:05 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:05.858025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:05.858644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:05.865622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.866112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.866543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.867282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.867730 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.868150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.922083 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:05.923554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:05.929642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=26 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:05.932553 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.933758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.934491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.935358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.936059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.936704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.967972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:05.978073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1a592134-bb16-45dc-ae26-1fea5e3f39f7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1241 microversion: 2.1 time: 0.125843 Sep 07 13:17:05.994427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 27/58] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:05 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1241 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:06.147945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.157481 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.158970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.160187 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-43392966-88b6-4e51-aaf4-dc561a706068 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.243111 Sep 07 13:17:06.160931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 32/59] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:05 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:06.217933 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:06.218545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:06.224801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:06.225391 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:06.225726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:06.226535 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:06.226883 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:06.227338 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:06.248203 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:06.282711 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:06.283349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:06.289317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:06.289794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:06.290222 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:06.290921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:06.291391 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:06.291811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:06.294684 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.302497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-11744545-44da-4807-a38b-8d254a4fe130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.089022 Sep 07 13:17:06.307648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 28/60] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:06 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:06.440185 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.448976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-84a009d1-e833-43d5-923b-13895c3dcc2b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.169710 Sep 07 13:17:06.449554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 33/61] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:06 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:07.006058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:07.007673 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:07.015871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.016744 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.017494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.018223 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.018680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.019120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.110922 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.118809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f23e8fb2-7c1f-4bde-8f7a-cca94d8d94bb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1241 microversion: 2.1 time: 0.117706 Sep 07 13:17:07.119423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 29/62] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:06 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:07.184664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:07.185266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:07.191387 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.191866 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.192294 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.192981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.193425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.193841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.326782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:07.328253 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:07.341018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.344422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.345196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.346159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.348432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.351368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.353783 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.366735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.368237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.369782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b79c7d30-b4b9-4430-b075-a08af8eff815 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.189079 Sep 07 13:17:07.370714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 34/63] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:07 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:07.424712 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.432765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7fe3be34-730e-4eca-a313-d8328b177d1b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.110725 Sep 07 13:17:07.433346 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 30/64] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:07 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:07.472517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:07.472979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:07.480243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.480748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.481175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.481883 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.482399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.482826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.657783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.666112 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1de73c73-f63b-4ec9-8a3b-d190805b46c6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.197567 Sep 07 13:17:07.666699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 35/65] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:07 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:08.145745 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:08.146825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:08.157095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.157969 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.158748 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.159547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.160023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.160443 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.244767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.253760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-723d0846-a1ae-46bf-97f9-07c781117bce tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1241 microversion: 2.1 time: 0.115119 Sep 07 13:17:08.254445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 31/66] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:08 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:08.394794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:08.395676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:08.403061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.403686 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.404189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.405116 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.405721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.406154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.455872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:08.456608 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:08.467954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.467954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.467954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.468529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.468924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.469441 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.559881 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.572485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6d7b06d5-bb20-4ac1-95b1-5e5649071620 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.120567 Sep 07 13:17:08.574542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 32/67] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:08 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:08.608587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.617370 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.618849 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.620093 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dcc41595-09ac-458c-8474-ee0a17a14b5e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.229251 Sep 07 13:17:08.620742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 36/68] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:08 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:08.701584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:08.702488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:08.711220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.711930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.712537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.713561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.714801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.715537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.958357 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.969394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c39f2712-1620-44bc-8a74-ff0ba1771c11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.274544 Sep 07 13:17:08.970619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 33/69] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:08 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:09.280463 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.281112 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:09.287919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.288421 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.288865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.290482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.290482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.290482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.363941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:09.374240 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2ca885ae-fbf1-43f7-9507-e68c92e4f893 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1241 microversion: 2.1 time: 0.099231 Sep 07 13:17:09.374823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 37/70] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:09 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:09.596819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.597678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:09.603453 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.603944 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.604524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.605795 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.606254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.606675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.646034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.646984 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:09.654993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.655753 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.656195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.656968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.657430 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.657889 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.673530 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:09.681075 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b70134d6-17fe-4a75-aa95-edf7ea84f2e7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.088034 Sep 07 13:17:09.681662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 34/71] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:09 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:09.809330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:09.817718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:09.819265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:09.820390 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b64286ab-8c50-4343-97dd-55a98e4c92e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.178383 Sep 07 13:17:09.820949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 38/72] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:09 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:09.996857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.996977 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:10.004601 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.005215 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.005802 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.006539 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.007483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.007925 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.397807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:10.398810 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:10.412519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.417579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.419728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.420719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.425728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.426519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.801513 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:10.811748 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0190c108-1f7b-4ce1-8870-6bb757bf1630 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.820157 Sep 07 13:17:10.813720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 35/73] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:09 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:10.818886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:10.819647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:10.837412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.838212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.840428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.840428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.844209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.844926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.041090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=4 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:11.081171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.093201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-28437e78-323e-4a2c-bc2f-cbadcea0dbf2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1233 microversion: 2.1 time: 0.699363 Sep 07 13:17:11.097618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 39/74] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:10 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1233 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:11.110604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:11.111535 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:11.133011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.133509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.135054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.136956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.137973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.138575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.174737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.184167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c002f1f4-8511-46e6-b02e-829aa43acc0d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.369215 Sep 07 13:17:11.185400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 36/75] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:10 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:11.333962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:11.490150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.501232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.502901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.504697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b879cf8f-1ee9-426b-b1ed-e1de01d4569d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.405450 Sep 07 13:17:11.506517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 40/76] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:11 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:11.838243 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:11.839507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:11.843399 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=26 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:11.848184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.849134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.849601 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.850352 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.850987 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.851599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.125843 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.128266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.157644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.159031 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.160282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.162063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.163312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.165977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.388856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.417885 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a06e88fb-b871-46c6-a3ca-4a7342690887 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.584830 Sep 07 13:17:12.418484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 37/77] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:11 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:12.446938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.449511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.467457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.467947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.471355 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.473115 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.474966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.476438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.569825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.580969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-068ec16f-8436-4c52-a2e3-13eef0e44b81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1297 microversion: 2.1 time: 0.462507 Sep 07 13:17:12.586802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 41/78] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:12 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1297 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:12.604781 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.607644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.628002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.629503 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.630211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.632444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.633173 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.636102 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.848587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.857275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-489f8920-50d0-47a0-972e-14f68eaf9bb4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1279 microversion: 2.1 time: 0.433231 Sep 07 13:17:12.878727 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 38/79] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:12 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1279 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:12.900545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-046c7577-20ee-4d78-97dd-5d41ecea842c req-253e1223-a39b-427c-a9c1-9fad8b92d132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e55303d-58ec-44db-a67c-2e9729dc076b", "tag": "acd78dee-6922-4a5c-ad1c-a064a3ba437b"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:12.940801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-046c7577-20ee-4d78-97dd-5d41ecea842c req-253e1223-a39b-427c-a9c1-9fad8b92d132 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.941293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-046c7577-20ee-4d78-97dd-5d41ecea842c req-253e1223-a39b-427c-a9c1-9fad8b92d132 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.943169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-046c7577-20ee-4d78-97dd-5d41ecea842c req-253e1223-a39b-427c-a9c1-9fad8b92d132 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.984698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-046c7577-20ee-4d78-97dd-5d41ecea842c req-253e1223-a39b-427c-a9c1-9fad8b92d132 service nova] Creating event network-changed:acd78dee-6922-4a5c-ad1c-a064a3ba437b for instance 6e55303d-58ec-44db-a67c-2e9729dc076b on hv-cinder-80403 Sep 07 13:17:12.985243 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-046c7577-20ee-4d78-97dd-5d41ecea842c req-253e1223-a39b-427c-a9c1-9fad8b92d132 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121070) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:17:12.985636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-046c7577-20ee-4d78-97dd-5d41ecea842c req-253e1223-a39b-427c-a9c1-9fad8b92d132 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121070) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:17:12.985861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.986824 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.997168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.999567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.000128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.004066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:13.007524 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-85dc4d57-f8a2-4595-a5ae-b5bb4f1b9c39 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.417156 Sep 07 13:17:13.008383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.008962 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.009482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.010267 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 42/80] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:12 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:13.034885 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.compute.rpcapi [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:17:13.037066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] Releasing lock "compute-rpcapi-router" {{(pid=121070) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:17:13.089387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c749e59f-bb2c-4243-a3f9-cb7eb9531c47 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205012 Sep 07 13:17:13.090888 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 39/81] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:13.460104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:13.460715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:13.476810 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.477320 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.477755 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.478467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.480033 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.480033 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.657370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:13.657723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:13.689390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.689390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.689390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.689390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.690261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.690261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.873901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:13.884526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4f9f4886-6dcf-460c-940b-c215b85281a0 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1295 microversion: 2.1 time: 0.234267 Sep 07 13:17:13.887365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 40/82] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:13 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1295 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:13.896537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:13.898092 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:13.907718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.908534 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.909194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.910103 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.911001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.912380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.126712 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.141656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-54b12929-37b7-48d2-888a-13edaeaeb272 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.685304 Sep 07 13:17:14.144375 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 43/83] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:13 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:14.152511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:14.153596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:14.169415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.170593 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.172427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.172427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.172427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.173131 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.637679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.653640 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b57a1184-65e4-4533-9831-e5f4d761a9bd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.759686 Sep 07 13:17:14.654659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 41/84] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:13 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:14.785631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.799232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.802664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.809248 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f41fba3b-a039-420b-a2f0-19ef37290f98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.661095 Sep 07 13:17:14.811061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 44/85] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:14 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:14.914634 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:14.915425 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:14.930192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.930705 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.934473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.937019 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.938758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.939835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.108222 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:15.121634 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e101dc8a-3edf-4a09-9842-55275bff160f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1295 microversion: 2.1 time: 0.210009 Sep 07 13:17:15.127497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 42/86] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:14 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1295 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:15.169987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:15.170826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:15.181375 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.185988 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.186679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.187934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.190315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.190992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.684605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:15.685460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:15.695017 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.695374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:15.695883 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.696423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.697395 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.698120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.698685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.712910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fed50bbe-6bdf-4790-8f62-52f141aadcac tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.547573 Sep 07 13:17:15.715700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 45/87] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:15 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:15.859713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:15.860743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:15.867618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.868545 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.869217 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.870215 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.871535 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.872192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.903379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:16.122750 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.139022 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-dbc477bc-af29-4613-bde6-77cec586a5b7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.459701 Sep 07 13:17:16.158738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 43/88] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:15 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:16.174427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:16.176360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:16.186650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.187693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.189067 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.190551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.191396 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.192261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.292986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.332412 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.337289 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.344290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c7935143-1197-49a3-bcce-074fb7f227dc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.489497 Sep 07 13:17:16.358597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 46/89] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:15 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:16.440570 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-d483f050-78d5-43db-814f-0fde125278dc req-5689edf3-25c2-4277-8c6c-870b02180998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4", "tag": "8f09e61a-18d1-47b4-af0c-2677ce493831"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:16.452804 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-d483f050-78d5-43db-814f-0fde125278dc req-5689edf3-25c2-4277-8c6c-870b02180998 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.453422 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-d483f050-78d5-43db-814f-0fde125278dc req-5689edf3-25c2-4277-8c6c-870b02180998 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.455083 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-d483f050-78d5-43db-814f-0fde125278dc req-5689edf3-25c2-4277-8c6c-870b02180998 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.471912 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-d483f050-78d5-43db-814f-0fde125278dc req-5689edf3-25c2-4277-8c6c-870b02180998 service nova] Creating event network-changed:8f09e61a-18d1-47b4-af0c-2677ce493831 for instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 on hv-cinder-80403 Sep 07 13:17:16.490910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-d483f050-78d5-43db-814f-0fde125278dc req-5689edf3-25c2-4277-8c6c-870b02180998 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053948 Sep 07 13:17:16.495614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 47/90] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:16.592944 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.604600 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bb9ce5f1-7e43-490f-b720-b996307cac13 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.435720 Sep 07 13:17:16.605532 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 44/91] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:16 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:16.769413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:16.770322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:16.784646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.785275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.785751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.786484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.786963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.787462 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.972010 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.996582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-77a268c6-3d1d-491d-832c-e6698cb17aed tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.230449 Sep 07 13:17:16.998221 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 48/92] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:16 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:17.166734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:17.167686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:17.177624 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.180448 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.181157 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.183672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.184359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.186882 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.222546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:17.377472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:17.378446 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:17.386940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.387786 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.388434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.389237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.389771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.390443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.526844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.541285 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8169779d-48f4-4bf5-8b43-feac47569a71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.378549 Sep 07 13:17:17.542190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 45/93] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:17 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:17.637209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:17.637969 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:17.646567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.647093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.647560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.648417 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.649021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.649615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.683444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.719352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.723152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.726154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e84dc524-4a11-44de-9aeb-354fcf678806 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.352074 Sep 07 13:17:17.727201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 49/94] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:17 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:17.907976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.922557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-46c291b1-3668-417f-b909-74c1e6cd4e69 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.291395 Sep 07 13:17:17.924054 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 46/95] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:17 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:18.023934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:18.024748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:18.036846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.038084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.038932 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.040062 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.040796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.041361 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.225826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:18.235203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-28a54faf-81a8-44ba-ab89-5c188e595f92 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.217814 Sep 07 13:17:18.235620 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 50/96] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:18 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:18.575124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:18.575816 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:18.583557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.584540 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.585155 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.585857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.586473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.586897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.772920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:18.773746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:18.781870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.785828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:18.789186 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.792928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.793675 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.794145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.794581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.803228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d947fb0b-ac1c-45cc-bf9d-0df2e05133c6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.233354 Sep 07 13:17:18.803837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 47/97] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:18 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:18.959062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:18.961770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:18.988063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.989359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.991386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.992386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.993064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.995018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.029579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.041715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.043950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.045956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2ce8b902-d82e-463f-b780-a7cf802c2975 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.278462 Sep 07 13:17:19.046780 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 51/98] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:18 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:19.194837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.205184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-76cae30e-5f23-4d75-ac71-421ce6bbb629 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.261032 Sep 07 13:17:19.206318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 48/99] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:18 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:19.265399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:19.266048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:19.272963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.273451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.274088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.274853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.275430 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.276588 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.450265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.460471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d8f12781-620d-453c-af49-aab0f2dc423f tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.199156 Sep 07 13:17:19.461065 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 52/100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:19 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:19.841045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:19.842849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:19.849511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.850363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.851045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.852506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.853330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.854011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.031037 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.040703 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1174e0b1-9aa3-467d-a3c8-935e27e7f028 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.204032 Sep 07 13:17:20.041724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 49/101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:19 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:20.073103 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:20.074293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:20.083460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.084218 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.084656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.085528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.086130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.086719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.242374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.245838 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:20.246569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:20.248734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:20.263392 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.264255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.264663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.265366 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.266892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.267153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.268336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.269099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-205e919d-fc20-4b9a-9a51-3098f1946ef1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.200533 Sep 07 13:17:20.269563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.270718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 53/102] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:20 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:20.456786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.466994 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3d9f4b5e-ff3c-43e0-87d5-8476edbf67b1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.228601 Sep 07 13:17:20.467692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 50/103] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:20 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:20.490531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:20.490941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:20.497363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.497862 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.498590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.499427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.499796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.500223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.703820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.718729 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bac120fe-a93f-4008-a563-9ce26d6a36b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.232454 Sep 07 13:17:20.722590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 54/104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:20 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:21.073712 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.074380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:21.089542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.090344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.091134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.092185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.092711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.093271 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.262088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.270558 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c98fe4e4-7a77-4b43-be49-bf2b422e7095 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.203649 Sep 07 13:17:21.271336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 51/105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:21 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:21.301980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.302808 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:21.309879 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.310663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.311415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.312258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.312844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.313362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.495966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.497434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:21.508599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.510031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.511011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.512609 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.513752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.514801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.529704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.546631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.550590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.553123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8f541d8f-c283-4174-abe0-d111e5fcc033 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.255186 Sep 07 13:17:21.554459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 55/106] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:21 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:21.752368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.753149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:21.753339 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.761150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.761788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.762292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.765139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.765810 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.766546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.768629 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4afaf209-805a-4b9e-a437-7976cf2a5c9d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.281070 Sep 07 13:17:21.769246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 52/107] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:21 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:21.961655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.977499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2fde7e00-138b-4f1a-a24f-5604fe7fd32a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.231693 Sep 07 13:17:21.979070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 56/108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:21 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:22.306926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:22.307800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:22.317841 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.318543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.319143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.324494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.324494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.324494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.543429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.552447 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e81b0b7d-0c9b-4434-86b5-a483b319ffc0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.251837 Sep 07 13:17:22.553179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 53/109] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:22 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:22.596128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:22.597268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:22.604458 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.604915 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.605522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.606240 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.606746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.607363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.798526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:22.799444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:22.801609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.809365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.816040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.816648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.818819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.819493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.820076 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.820310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.825036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.827615 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ec2514b3-012e-4fb0-8f10-fbf42639137d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.235615 Sep 07 13:17:22.828702 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 57/110] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:22 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:23.002887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:23.003537 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:23.011028 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.011551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.012139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.012863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.013308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.014145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.031562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:23.382742 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:23.401828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c61af527-ce5c-449b-8f48-0fe1d8c3e270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.607261 Sep 07 13:17:23.402945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 54/111] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:22 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:23.482340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:23.502437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1ddc81e8-2d88-420f-b515-6b0a747e4bd1 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.503715 Sep 07 13:17:23.503054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 58/112] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:22 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:23.581129 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:23.582671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:23.594045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.594871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.595666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.596884 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.597970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.598718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.793025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:23.803348 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0685b0f7-e3b0-4a49-aa6c-e13987e345d1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.229737 Sep 07 13:17:23.804394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 55/113] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:23 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:23.856846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:23.861625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:23.869721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.870380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.870960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.871943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.873104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.873693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.068949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.080243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.081848 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.082891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-506b3353-b55f-4382-84e2-8fec3eb278f1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.232320 Sep 07 13:17:24.083585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 59/114] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:23 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:24.430501 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:24.431098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:24.437878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.438221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.438663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.439473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.440184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.440623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.529490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:24.530419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:24.537152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.537743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.538072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.539149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.540072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.540072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.637579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.654107 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-31c7f12f-ee09-4c24-892e-ccf38ecd4c85 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.227030 Sep 07 13:17:24.655244 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 56/115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:24 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:24.720270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.728968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2421573e-4b12-43b5-aeb9-b20721e57974 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.203402 Sep 07 13:17:24.729565 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 60/116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:24 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:24.844172 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:24.845039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:24.854262 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.854994 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.855589 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.856470 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.857111 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.857746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.110276 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:25.111288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.123817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.124322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.125721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.127931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.129394 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.132690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.192845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.211902 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d6f9bd21-4c4a-4ad3-a3fa-8e3b1d685339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.372768 Sep 07 13:17:25.213394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 57/117] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:24 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:25.628189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.638267 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.647753 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.652043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b0f9bc0d-f16c-4a8e-b273-ce35a62d881b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.543040 Sep 07 13:17:25.667541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 61/118] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:25 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:25.689081 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:25.690529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.699655 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.700763 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.701415 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.702316 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.702954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.703598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.769566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:25.770364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.780785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.780785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.780971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.781784 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.782450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.782875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.325780 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.338736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c5c106a4-fd3d-4de2-8a7f-21beb4ce7184 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.654751 Sep 07 13:17:26.341531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 58/119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:25 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:26.356719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:26.357613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:26.373676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.374445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.375033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.377132 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.377784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.386313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.386517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.398039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1a3683ea-71e5-4e89-8466-f376ca0c89ee tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.632801 Sep 07 13:17:26.402064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 62/120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:25 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:26.695761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-ed11ec0a-9a78-493a-a9c1-87458c2800cf req-59e72467-aeba-4de1-8d9b-7743153858bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa967676-e023-44fe-af50-47db2225c4c5", "name": "network-vif-plugged", "status": "completed", "tag": "d09ff3be-283a-4f61-92b6-2a7fe58192db"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:26.709202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ed11ec0a-9a78-493a-a9c1-87458c2800cf req-59e72467-aeba-4de1-8d9b-7743153858bd service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.709900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ed11ec0a-9a78-493a-a9c1-87458c2800cf req-59e72467-aeba-4de1-8d9b-7743153858bd service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.710519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ed11ec0a-9a78-493a-a9c1-87458c2800cf req-59e72467-aeba-4de1-8d9b-7743153858bd service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.725933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-ed11ec0a-9a78-493a-a9c1-87458c2800cf req-59e72467-aeba-4de1-8d9b-7743153858bd service nova] Creating event network-vif-plugged:d09ff3be-283a-4f61-92b6-2a7fe58192db for instance aa967676-e023-44fe-af50-47db2225c4c5 on hv-cinder-80403 Sep 07 13:17:26.732295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-ed11ec0a-9a78-493a-a9c1-87458c2800cf req-59e72467-aeba-4de1-8d9b-7743153858bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310101 Sep 07 13:17:26.737846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 63/121] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:26.743717 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:26.745216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:26.752634 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.753569 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.754169 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.755046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.755783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.756600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.779032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:26.798851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.812135 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-49163d80-2300-403e-b252-a442e984a3ca tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.469083 Sep 07 13:17:26.813058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 59/122] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:26 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:27.059604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:27.069544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:27.073342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:27.079041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0e91c79b-127e-4da5-a9a5-9df086aa2c23 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.339137 Sep 07 13:17:27.080161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 64/123] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:26 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:27.263705 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-1eb977f5-5793-4cec-a1a8-e9ffd7e2a89b req-f0ee8290-da03-4947-98a4-b2205c9cbc18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6", "tag": "3986b26f-25d2-4ffe-9e10-5f1071509fb2"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:27.295438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1eb977f5-5793-4cec-a1a8-e9ffd7e2a89b req-f0ee8290-da03-4947-98a4-b2205c9cbc18 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.296204 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1eb977f5-5793-4cec-a1a8-e9ffd7e2a89b req-f0ee8290-da03-4947-98a4-b2205c9cbc18 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.296725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1eb977f5-5793-4cec-a1a8-e9ffd7e2a89b req-f0ee8290-da03-4947-98a4-b2205c9cbc18 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.321490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-1eb977f5-5793-4cec-a1a8-e9ffd7e2a89b req-f0ee8290-da03-4947-98a4-b2205c9cbc18 service nova] Creating event network-changed:3986b26f-25d2-4ffe-9e10-5f1071509fb2 for instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 on hv-cinder-80403 Sep 07 13:17:27.328264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-1eb977f5-5793-4cec-a1a8-e9ffd7e2a89b req-f0ee8290-da03-4947-98a4-b2205c9cbc18 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070711 Sep 07 13:17:27.328878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 60/124] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:27.368283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:27.369180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:27.377568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.378122 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.378564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.379316 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.379775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.380202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.435386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:27.436202 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:27.443318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.448078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.449714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.451865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.452442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.453801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.892887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:27.901623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cad34d1a-ee59-4411-bc4d-881d7f972e31 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.538079 Sep 07 13:17:27.902200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 65/125] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:27 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:27.914773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:27.915451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:27.943764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.944593 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.946546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.948526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.949211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.949962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.102732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:28.128736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-98bf5575-03c0-4ef1-82a5-b9184614cd6d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.684421 Sep 07 13:17:28.132277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 61/126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:27 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:28.149202 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:28.151789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:28.174127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.174343 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.179002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.181473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.182427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.183819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.598728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:28.608585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-20690bc1-52c5-47df-933f-98c338f4e5df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.701372 Sep 07 13:17:28.609925 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 66/127] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:27 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:28.679858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:28.686679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:28.694120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:28.696474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:28.697993 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fbb56d19-e63b-4d3c-be23-fd28fa30624e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.561140 Sep 07 13:17:28.698816 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 62/128] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:28 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:28.750322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-ddb86717-65ee-41e2-8a81-778aaddb4c17 req-e3f5a48e-839c-48d8-a041-622b2217d627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e020bf09-5375-498a-b72c-4467376b0b7c", "name": "network-vif-plugged", "status": "completed", "tag": "2e0f07aa-fa54-42a6-98a3-af1a44859d05"}, {"server_uuid": "6e55303d-58ec-44db-a67c-2e9729dc076b", "name": "network-vif-plugged", "status": "completed", "tag": "acd78dee-6922-4a5c-ad1c-a064a3ba437b"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:28.761867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ddb86717-65ee-41e2-8a81-778aaddb4c17 req-e3f5a48e-839c-48d8-a041-622b2217d627 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.762937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ddb86717-65ee-41e2-8a81-778aaddb4c17 req-e3f5a48e-839c-48d8-a041-622b2217d627 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.763785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ddb86717-65ee-41e2-8a81-778aaddb4c17 req-e3f5a48e-839c-48d8-a041-622b2217d627 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.780944 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-ddb86717-65ee-41e2-8a81-778aaddb4c17 req-e3f5a48e-839c-48d8-a041-622b2217d627 service nova] Creating event network-vif-plugged:2e0f07aa-fa54-42a6-98a3-af1a44859d05 for instance e020bf09-5375-498a-b72c-4467376b0b7c on hv-cinder-80403 Sep 07 13:17:28.781484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-ddb86717-65ee-41e2-8a81-778aaddb4c17 req-e3f5a48e-839c-48d8-a041-622b2217d627 service nova] Creating event network-vif-plugged:acd78dee-6922-4a5c-ad1c-a064a3ba437b for instance 6e55303d-58ec-44db-a67c-2e9729dc076b on hv-cinder-80403 Sep 07 13:17:28.789379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-ddb86717-65ee-41e2-8a81-778aaddb4c17 req-e3f5a48e-839c-48d8-a041-622b2217d627 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043098 Sep 07 13:17:28.793763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 67/129] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:17:28.939028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:28.939953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:28.947328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.947828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.948267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.949384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.949847 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.950272 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.173309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:29.174027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:29.187604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.188113 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.188560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.189283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.189745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.190168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.203587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:29.215393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5114a83a-0e3b-49c2-a7f9-c52f5d58ec5a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.282385 Sep 07 13:17:29.217194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 63/130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:28 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:29.467473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:29.496257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-742b2035-ceb3-4f02-b588-845e2e4867cb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.329695 Sep 07 13:17:29.513762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 68/131] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:29 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:29.633740 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:29.634898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:29.647674 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.648185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.648625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.649565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.649886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.650832 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.740233 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:29.741303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:29.751790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.752891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.753429 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.754678 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.755290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.755959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.188025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:30.200603 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7e21b3d3-4014-4ee1-a8a1-2925ccaf528d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.569145 Sep 07 13:17:30.201251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 64/132] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:29 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:30.241291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:30.241957 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:30.254739 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.256375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.256947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.258351 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.260048 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.260494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.312319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:30.332114 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:30.334689 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:30.341130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4fa6795b-b143-40da-8cb6-41b3cb6ef3b6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.614072 Sep 07 13:17:30.342835 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 69/133] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:29 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:30.544623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:30.545474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:30.555443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.556855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.563641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.566480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.567174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.568011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.656936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:30.685835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-dc184424-6ab0-42a4-ad8f-6b3f2677fdd3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.448569 Sep 07 13:17:30.689264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 65/134] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:30 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:30.901270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:30.914535 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-76669414-1adc-461d-a56b-11a9abf953b7 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.374103 Sep 07 13:17:30.916171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 70/135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:30 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:31.230480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:31.231770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:31.244917 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.245878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.246655 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.248168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.249282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.250142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.371746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:31.372474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:31.383167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.385903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.386490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.387341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.389256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.389987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.562880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:31.574882 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4b4320c0-bdb8-4fa6-ae55-015da2ccdd73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.351472 Sep 07 13:17:31.575828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 66/136] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:31 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:31.616041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:31.625108 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:31.626737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:31.628034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5fc06164-cde0-41d0-93ad-f94d5568ec1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1407 microversion: 2.20 time: 0.260583 Sep 07 13:17:31.628583 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 71/137] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:31 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:31.716920 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:31.718098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:31.724083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.724582 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.725022 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.725784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.726164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.726913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.881189 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:31.892049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-87a2ff3b-e8ea-408d-b3ef-9983846d2d52 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.181052 Sep 07 13:17:31.893457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 67/138] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:31 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:31.941492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:31.952140 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:31.959774 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.960350 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.960989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.962007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.963135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.963749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.261446 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-d139cc95-de4c-47a2-8b1e-70b23b0dad11 req-fa99b680-65fb-4965-8a36-2739233dd899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4", "name": "network-vif-plugged", "status": "completed", "tag": "8f09e61a-18d1-47b4-af0c-2677ce493831"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:32.285099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d139cc95-de4c-47a2-8b1e-70b23b0dad11 req-fa99b680-65fb-4965-8a36-2739233dd899 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.288536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d139cc95-de4c-47a2-8b1e-70b23b0dad11 req-fa99b680-65fb-4965-8a36-2739233dd899 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.289872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d139cc95-de4c-47a2-8b1e-70b23b0dad11 req-fa99b680-65fb-4965-8a36-2739233dd899 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.327630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:32.335511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-d139cc95-de4c-47a2-8b1e-70b23b0dad11 req-fa99b680-65fb-4965-8a36-2739233dd899 service nova] Creating event network-vif-plugged:8f09e61a-18d1-47b4-af0c-2677ce493831 for instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 on hv-cinder-80403 Sep 07 13:17:32.335933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0a89194e-9f7f-49f0-8a0f-64aa9239ce11 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.398870 Sep 07 13:17:32.337098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 72/139] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:31 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:32.354214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-d139cc95-de4c-47a2-8b1e-70b23b0dad11 req-fa99b680-65fb-4965-8a36-2739233dd899 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098541 Sep 07 13:17:32.356299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 68/140] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:32.599127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:32.600319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:32.607797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.608287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.609150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.609734 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.610192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.610617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.657274 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:32.658648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:32.667207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.667980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.668456 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.669949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.670552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.671136 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.869936 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:32.878636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-19d8982d-3ccf-4f9a-be4d-7139a8c3a80a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.284581 Sep 07 13:17:32.892843 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 73/141] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:32 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:32.907850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:32.916096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:32.916706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:32.918513 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:32.921479 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:32.923270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1200b409-aa1f-4c8b-af9c-79bedcbd040f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1598 microversion: 2.20 time: 0.270051 Sep 07 13:17:32.923935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 69/142] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:32 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1598 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:32.930698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.932095 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.932688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.933810 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.934413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.934989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.951059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:32.951862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:32.959190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.959768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.960253 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.961038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.961577 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.962107 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.144865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e52bd66b-8684-4fec-983f-a3f991e6bb16 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.197723 Sep 07 13:17:33.146183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 70/143] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Sep 7 13:17:32 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:17:33.149586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:33.161496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9c90e0e0-4bdf-474f-84ca-c95f6f3df015 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.249120 Sep 07 13:17:33.164382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 74/144] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:32 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:33.362517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:33.363145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:33.370698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.371132 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.371896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.373123 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.373856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.374365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.912506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:33.913110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:33.923435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.924061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.924341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.925050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.925499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.925922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.934781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:33.957869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7918fbd9-a97f-492d-8230-0946e2f6b211 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1314 microversion: 2.1 time: 0.584684 Sep 07 13:17:33.958549 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 71/145] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:33 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:34.186362 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:34.187128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:34.194053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:34.194790 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:34.195649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:34.197303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:34.198173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:34.198787 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:34.440111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:34.452459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d0720802-2ff5-472d-8104-30ae8504fc77 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.551435 Sep 07 13:17:34.453048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 75/146] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:33 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:34.632317 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:34.640792 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a41b580c-c17b-46a8-985c-98278240cf17 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.458540 Sep 07 13:17:34.659990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 72/147] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:34 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:34.991811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:34.992562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:34.996670 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=91 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:35.006996 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:35.007892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:35.008476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.010099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:35.010726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:35.011334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.475985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:35.476755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:35.486548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:35.490468 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:35.491219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.492139 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:35.494181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:35.494887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.862776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:35.872799 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-81c48efd-3691-4ada-b461-b8b8e832395a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1501 microversion: 2.1 time: 0.886031 Sep 07 13:17:35.874423 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 76/148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:34 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1501 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:35.882515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:35.883601 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:35.894032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:35.895231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:35.896032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.896997 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:35.897750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:35.898350 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.984879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:36.001201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c191b3b9-2fa5-4439-93b3-fde8a3d1c792 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.527351 Sep 07 13:17:36.013110 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 73/149] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:35 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:36.014964 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-b6457bda-7372-44d1-82eb-1cb8ee37245f req-b73174d2-e4a9-4d7d-a34f-50c7407b038d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa967676-e023-44fe-af50-47db2225c4c5", "tag": "d09ff3be-283a-4f61-92b6-2a7fe58192db"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:36.037245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b6457bda-7372-44d1-82eb-1cb8ee37245f req-b73174d2-e4a9-4d7d-a34f-50c7407b038d service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:36.037996 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b6457bda-7372-44d1-82eb-1cb8ee37245f req-b73174d2-e4a9-4d7d-a34f-50c7407b038d service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:36.038687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b6457bda-7372-44d1-82eb-1cb8ee37245f req-b73174d2-e4a9-4d7d-a34f-50c7407b038d service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:36.073563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-b6457bda-7372-44d1-82eb-1cb8ee37245f req-b73174d2-e4a9-4d7d-a34f-50c7407b038d service nova] Creating event network-changed:d09ff3be-283a-4f61-92b6-2a7fe58192db for instance aa967676-e023-44fe-af50-47db2225c4c5 on hv-cinder-80403 Sep 07 13:17:36.091914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-b6457bda-7372-44d1-82eb-1cb8ee37245f req-b73174d2-e4a9-4d7d-a34f-50c7407b038d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088228 Sep 07 13:17:36.092678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 74/150] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:36.138690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:36.152612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-54444c7d-3866-4765-91b6-d8c729a2cb2b tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.276643 Sep 07 13:17:36.153572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 77/151] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:35 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:37.031096 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:37.032296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:37.047263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.047823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.048220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.049125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.051444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.051910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.183415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:37.184086 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:37.206305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.206804 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.220809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.222906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.238231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.238871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.351267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:37.374878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c8ce99b4-0a1c-4e8b-bdaa-6779c3c8cced tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.349573 Sep 07 13:17:37.382004 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 75/152] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:37 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:37.576052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:37.593858 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-95c1d525-af95-4aa4-8c74-43dc58b7ea0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.417938 Sep 07 13:17:37.611839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 78/153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:37 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:38.404701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:38.405450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:38.411550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:38.412039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:38.412474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:38.413168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:38.413624 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:38.414042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:38.583525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:38.594653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0c47fbc1-ca98-47e1-95ae-fc0f1941619d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.193799 Sep 07 13:17:38.595445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 76/154] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:38 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:38.624416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:38.624993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:38.631510 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:38.632004 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:38.636066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:38.636066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:38.636066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:38.636066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:38.782656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:38.794225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-74d84150-8a75-4d50-98bc-591a986b2ed3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.173328 Sep 07 13:17:38.795366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 79/155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:38 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:39.621327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:39.623893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:39.631721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:39.632444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:39.632941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:39.633724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:39.634766 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:39.635220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:39.807983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:39.817042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-16fe14ae-fd33-48e1-9099-9f3f0345c83e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.200543 Sep 07 13:17:39.817629 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 77/156] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:39 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:39.829456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:39.830171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:39.836377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:39.837444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:39.837880 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:39.838575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:39.839027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:39.839472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:39.976455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:39.985098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3f953a6c-f490-47d8-8625-21bbd298b780 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.159631 Sep 07 13:17:39.985599 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 80/157] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:39 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:40.840631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:40.841270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:40.847909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:40.848671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:40.849116 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:40.849814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:40.850270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:40.850693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:40.994430 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:41.003153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-eb9a3a64-4aa6-4399-b697-47381598f19e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.166886 Sep 07 13:17:41.003749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 78/158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:40 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:41.008169 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:41.009416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:41.015848 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:41.016332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:41.016763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:41.017461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:41.017906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:41.018326 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:41.155338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:41.158763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:41.163748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d98a07ad-1051-471b-aa2f-a013d3815f2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.159587 Sep 07 13:17:41.164304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 81/159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:41 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:41.919081 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14ee5ac0-5098-49fe-8ce5-897f50e666c7"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:41.922030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:41.928628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:41.929119 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:41.929721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:41.931175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:41.931598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:41.932702 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.031539 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:42.032623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:42.042650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.043209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.043650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.044353 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.044930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.045356 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.250341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:42.267679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a18e6361-779d-4db1-bbf6-84f3bc882d64 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.243219 Sep 07 13:17:42.268267 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 82/160] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:42 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:42.273062 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:42.273665 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:42.283350 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.283906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.285343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.286917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.287634 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.288386 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.516914 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:42.528644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-457fdd1f-64a9-41f6-ba17-34fdbaaab987 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.258608 Sep 07 13:17:42.530382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 83/161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:42 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:43.220327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:43.231775 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7dbcc6a8-01c9-4a67-b088-1e736bc71bf3 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "POST /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.321532 Sep 07 13:17:43.233615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 79/162] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:17:41 2022] POST /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c/os-volume_attachments => generated 194 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:43.294112 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:43.295323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:43.302165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.302901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.303558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.304491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.305309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.305907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.508568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:43.517563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2fd2541d-102f-4676-a6cc-e46ba98cec05 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1321 microversion: 2.1 time: 0.231133 Sep 07 13:17:43.518167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 84/163] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:43 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:43.560950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:43.560950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:43.566032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.566526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.566955 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.567715 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.568126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.568557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.721749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:43.730063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bc20a4a4-64d4-4be4-b946-245093f76f03 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.176052 Sep 07 13:17:43.730650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 80/164] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:43 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:44.545775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:44.546524 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:44.552491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.552971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.553403 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.554088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.554535 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.554945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.705183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:44.713470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-44164ad3-4764-45e8-b50b-d32d39c9ce5f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1515 microversion: 2.1 time: 0.171479 Sep 07 13:17:44.714039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 85/165] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:44 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:44.736793 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:44.739329 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:44.747269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.747768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.748209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.748921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.749370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.749794 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.754099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:44.754833 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:44.761447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.761927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.762352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.763039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.763516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.763931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.775485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lazy-loading 'flavor' on Instance uuid b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:44.909568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3584e3a3-9113-4d20-bedd-4faa92c84533 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4/action" status: 200 len: 32 microversion: 2.1 time: 0.177019 Sep 07 13:17:44.910193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 81/166] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:17:44 2022] POST /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:17:44.916288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:44.920843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:44.921537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:44.924639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ac5c9b72-ebec-4897-b27f-e1c5ec0d3a68 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.174351 Sep 07 13:17:44.925300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 86/167] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:44 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:44.928156 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.928667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.929082 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.929845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.930334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.930755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:45.069772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:45.077812 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9b8137e3-3c4b-4e49-a2df-3a13ce725df4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.161312 Sep 07 13:17:45.078445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 82/168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:44 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:45.947701 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:45.948232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:45.958335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:45.958821 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:45.959300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:45.960001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:45.960455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:45.960881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:46.102054 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:46.102770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:46.109891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:46.110522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:46.111312 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:46.112001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:46.112484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:46.113011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:46.124364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:46.134087 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-75283804-d43f-41d3-9c83-5853d7e9d76a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.190160 Sep 07 13:17:46.138160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 87/169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:45 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:46.255394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:46.263975 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2440ab48-c39b-4251-9b08-531627de57d2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.166890 Sep 07 13:17:46.264564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 83/170] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:46 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:47.158321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:47.159142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:47.165153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:47.165634 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:47.166068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:47.166771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:47.167381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:47.167811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:47.287768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:47.288376 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:47.295726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:47.296212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:47.296644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:47.297345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:47.297797 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:47.298218 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:47.307280 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:47.315132 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-533dd3ae-f7ce-441f-b904-3d11ff698ff3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.160743 Sep 07 13:17:47.316015 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 88/171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:47 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:47.430290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:47.438566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0e6e7dd8-c4fd-4663-9530-7788d308feb9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.154733 Sep 07 13:17:47.439175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 84/172] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:47 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:48.344168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:48.344815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:48.350983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.351510 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.353523 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.354276 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.355164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.355617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.467678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:48.468897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:48.475491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.475992 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.476418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.478001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.478653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.479265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.515359 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:48.524524 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e8f842bb-7c7a-466d-a1d5-3f6ad4790eb1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.185540 Sep 07 13:17:48.525498 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 89/173] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:48 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:48.577403 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-fcdf70ae-14ba-4775-8361-5f6e8b4e168d req-2e234f1e-3702-47f6-95f5-335ed257a773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6", "name": "network-vif-plugged", "status": "completed", "tag": "3986b26f-25d2-4ffe-9e10-5f1071509fb2"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:48.595793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-fcdf70ae-14ba-4775-8361-5f6e8b4e168d req-2e234f1e-3702-47f6-95f5-335ed257a773 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.596849 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-fcdf70ae-14ba-4775-8361-5f6e8b4e168d req-2e234f1e-3702-47f6-95f5-335ed257a773 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.597797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-fcdf70ae-14ba-4775-8361-5f6e8b4e168d req-2e234f1e-3702-47f6-95f5-335ed257a773 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.616853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-fcdf70ae-14ba-4775-8361-5f6e8b4e168d req-2e234f1e-3702-47f6-95f5-335ed257a773 service nova] Creating event network-vif-plugged:3986b26f-25d2-4ffe-9e10-5f1071509fb2 for instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 on hv-cinder-80403 Sep 07 13:17:48.623072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-fcdf70ae-14ba-4775-8361-5f6e8b4e168d req-2e234f1e-3702-47f6-95f5-335ed257a773 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055875 Sep 07 13:17:48.624047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 90/174] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:48.654026 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:48.670995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7308eab9-9b6c-49b7-bb6a-5ec9b2afd5d4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.206704 Sep 07 13:17:48.682814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 85/175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:48 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:49.552338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:49.553034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:49.559193 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.559685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.560121 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.560813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.561265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.561690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.699147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:49.700041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:49.716654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:49.720664 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.721527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.722144 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.723250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.723859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.724459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.731168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ab77ac08-c5bb-48ee-b870-e813f570a9fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.182910 Sep 07 13:17:49.732035 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 91/176] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:49 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:49.907516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:49.920709 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-52b392ad-1363-4737-a667-9c0fcaee659f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.227647 Sep 07 13:17:49.921622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 86/177] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:49 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:50.755333 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:50.755948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:50.767163 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.776261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.776745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:50.777566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.779178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.786112 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:50.945292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:50.946037 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:50.949326 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=74 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:50.969644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.971465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.971917 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:50.972772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.973259 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.973689 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:51.070522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:51.093968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0e86cb22-aee4-42b8-bf08-3518191455a5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1363 microversion: 2.1 time: 0.342856 Sep 07 13:17:51.123566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 92/178] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:50 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:51.253680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:51.268382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ce6a9d77-ec90-4b9c-ba2f-9a1e0b49a1b6 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.327443 Sep 07 13:17:51.269102 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 87/179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:50 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:52.134094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:52.137307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:52.148058 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.149558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.150156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.151245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.152054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.152683 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.302914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:52.303681 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:52.314278 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.315859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.316490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.317318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.318354 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.318354 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.387163 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:52.396845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dac25800-a654-42f8-a93e-b11f27d8767e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1547 microversion: 2.1 time: 0.269969 Sep 07 13:17:52.402052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 93/180] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:52 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1547 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:52.422723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:52.424099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:52.435927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.437123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.438706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.440829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.441743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.442494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.649449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:52.669382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d722a95a-00bf-47f4-830b-ac3b586c3173 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251968 Sep 07 13:17:52.670612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 94/181] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:17:52 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:52.687765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-01452cc0-9758-47d8-a31b-42ed1b1c595f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.388599 Sep 07 13:17:52.690623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 88/182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:52 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:53.759957 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:53.761036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:53.785369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.786057 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.787156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:53.788161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.800209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.801769 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:54.208346 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:54.220941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-208e593a-3bfa-40ce-8b86-085364e3a4b9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.496934 Sep 07 13:17:54.224453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 95/183] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:53 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:54.948623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-e7cd00f4-9769-4228-9f87-017e846c084f req-93a1eb1c-120b-4181-a1d5-31c3b65bdedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6", "tag": "3986b26f-25d2-4ffe-9e10-5f1071509fb2"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:54.964927 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e7cd00f4-9769-4228-9f87-017e846c084f req-93a1eb1c-120b-4181-a1d5-31c3b65bdedc service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:54.965406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e7cd00f4-9769-4228-9f87-017e846c084f req-93a1eb1c-120b-4181-a1d5-31c3b65bdedc service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:54.972766 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e7cd00f4-9769-4228-9f87-017e846c084f req-93a1eb1c-120b-4181-a1d5-31c3b65bdedc service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.001058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-e7cd00f4-9769-4228-9f87-017e846c084f req-93a1eb1c-120b-4181-a1d5-31c3b65bdedc service nova] Creating event network-changed:3986b26f-25d2-4ffe-9e10-5f1071509fb2 for instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 on hv-cinder-80403 Sep 07 13:17:55.015171 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-e7cd00f4-9769-4228-9f87-017e846c084f req-93a1eb1c-120b-4181-a1d5-31c3b65bdedc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069505 Sep 07 13:17:55.020599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 89/184] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:55.249240 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:55.249857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:55.260277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.261084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.261682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.267011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.267742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.268714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:56.298328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:56.309296 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-76b00a0e-ba40-4989-bb97-48691408d526 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 1.063871 Sep 07 13:17:56.324764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 96/185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:55 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:57.334893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:57.335657 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:57.342625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:57.343130 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:57.343622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:57.344326 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:57.344776 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:57.345239 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:57.515445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:57.524041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0199d31f-5b59-4ec3-99de-86150b402fbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.193793 Sep 07 13:17:57.524628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 90/186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:57 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:58.331143 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1065701179", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "networks": [{"uuid": "ad244cdf-4250-43dd-aa10-a3da69f80c40"}]}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:58.400049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] validate_networks() for [('ad244cdf-4250-43dd-aa10-a3da69f80c40', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:17:58.555957 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:58.556513 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:58.564318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:58.565029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:58.565668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:58.566420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:58.566814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:58.567261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:58.922877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:58.937717 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e41ec9b2-7ebb-4dfc-90a2-e44a82382e14 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.392476 Sep 07 13:17:58.938589 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 91/187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:58 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:59.059706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:17:59.060451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:17:59.060929 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:17:59.062018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:17:59.062672 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:17:59.079005 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.079590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.080117 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:59.080826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.081287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.081973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:59.116466 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Getting quotas for project 6d3b344911654d3a83328d54b8feca0e. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:59.121683 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Getting quotas for user 3f93418e3e264a1f8597f789ee888b4e and project 6d3b344911654d3a83328d54b8feca0e. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:59.135271 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:17:59.137686 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:17:59.189776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-313f9b3b-dccd-4d84-b2f1-1a49d0787090 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863036 Sep 07 13:17:59.190706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 97/188] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:17:59.203284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-de1e95a3-29fd-437f-9ff4-5de76f0fca8a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:59.203904 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-de1e95a3-29fd-437f-9ff4-5de76f0fca8a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:59.276320 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-de1e95a3-29fd-437f-9ff4-5de76f0fca8a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:59.289498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-de1e95a3-29fd-437f-9ff4-5de76f0fca8a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1214 microversion: 2.1 time: 0.090783 Sep 07 13:17:59.290120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 92/189] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:59 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:59.962354 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:59.963538 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:59.985695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.989747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.990564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:59.993595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.994127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.994581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.256761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:00.306201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ca744956-c6d3-4e93-8bf8-f54663e8fabb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.348241 Sep 07 13:18:00.310625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 98/190] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:59 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:00.313801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:00.314563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:00.331700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.331700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.331700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.331700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.332265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.332265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.347865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:00.348437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:00.364541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.365045 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.365485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.368328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.368818 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.369260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.430041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:00.438125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:00.439854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-06584779-153a-4b86-a9d1-e4c8565976b5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1266 microversion: 2.1 time: 0.130713 Sep 07 13:18:00.441291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 93/191] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:00 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:00.463881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:00.556681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b8f59814-29c6-4079-9fc8-202b16d2cda8 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 204 len: 0 microversion: 2.1 time: 0.213529 Sep 07 13:18:00.557423 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 99/192] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:00 2022] DELETE /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:18:00.566822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:00.568700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:00.586178 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.587378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.588192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.589730 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.591053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.592198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.838524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:00.847565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c4633135-ef8c-4fa9-bfb0-240aa972698b tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1553 microversion: 2.1 time: 0.285504 Sep 07 13:18:00.848141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 94/193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:00 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:01.336814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:01.337677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:01.345972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.346415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.347334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.348094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.348808 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.349461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.479276 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:01.482522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:01.492756 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.493557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.494332 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.495579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.497211 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.497956 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.529577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:01.538530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-60aa8c28-ced7-4e44-b7c9-f0a7b5fdc992 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.207839 Sep 07 13:18:01.539691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 100/194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:01 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:01.582985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:01.602487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-95ece169-b440-44a4-8a6b-5b5d93764f2e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1266 microversion: 2.1 time: 0.129854 Sep 07 13:18:01.603088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 95/195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:01 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:01.872836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:01.874369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:01.881705 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.882731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.883582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.884647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.885338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.885971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.052014 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:02.061802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6f894da0-fb04-43e3-baee-e7ee7d4fb122 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1553 microversion: 2.1 time: 0.193578 Sep 07 13:18:02.062722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 101/196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:01 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:02.565282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:02.565986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:02.573648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.574145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.574578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.575329 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.575976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.576441 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.581131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:02.629982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:02.632637 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:02.639550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.640366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.641545 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.642569 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.643222 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.643980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.766957 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:02.790097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1a60d29f-728d-41ca-b76e-211ae0e676e8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1266 microversion: 2.1 time: 0.166541 Sep 07 13:18:02.792356 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:02.796903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 102/197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:02 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:02.812492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-981de679-5c6d-4519-8e3e-7ff46689b9ab tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.253745 Sep 07 13:18:02.813169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 96/198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:02 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:03.086698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:03.087265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:03.094693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.095288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.095729 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.096454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.096948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.097384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.248324 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:03.258283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a959c442-04bb-4496-a708-08bdd4e5243d tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1553 microversion: 2.1 time: 0.175545 Sep 07 13:18:03.258885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 103/199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:03 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:03.813968 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:03.814577 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:03.821122 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.821619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.822053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.822761 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.823236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.823845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.838192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:03.838899 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:03.846339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.847219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.848404 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.849465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.850235 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.852061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.921146 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:03.929916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-adde4981-85f0-4a47-aba0-e93f54a66f45 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1266 microversion: 2.1 time: 0.119685 Sep 07 13:18:03.944911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 97/200] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:03 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:04.053304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:04.061771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0c3da61f-dab0-4ec6-9d43-5defd57de6e1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.228501 Sep 07 13:18:04.062437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 104/201] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:03 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:04.282746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:04.283446 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:04.290663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.291060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.291517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.292225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.292720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.293137 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.469196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:04.478412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6f54f9e5-060f-4c6c-8f9f-0d44bb35cead tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1553 microversion: 2.1 time: 0.200642 Sep 07 13:18:04.478993 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 98/202] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:04 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:04.955308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:04.955814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:04.963219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.963893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.964330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.965060 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.965521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.965976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:05.034667 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:05.042372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7fcf09b2-c972-4dcb-855d-2d58c211d8fd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1266 microversion: 2.1 time: 0.091072 Sep 07 13:18:05.042949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 105/203] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:04 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:05.085558 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:05.086141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:05.093148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:05.093734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:05.094154 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:05.094850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:05.095323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:05.095814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:05.229936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:05.238373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f0a7a632-c98b-43c4-8278-1e1e85af5e67 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.156860 Sep 07 13:18:05.238960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 99/204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:05 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:05.502069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:05.502678 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:05.504667 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:05.510510 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:05.511000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:05.511459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:05.512160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:05.512611 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:05.513035 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:05.667047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:05.687166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f9d7f828-cdbb-4dfb-95b3-08afaf5b8b03 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1553 microversion: 2.1 time: 0.188425 Sep 07 13:18:05.688175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 106/205] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:05 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:06.066698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:06.067400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:06.083240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.084015 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.084603 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.086124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.087605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.088210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.185759 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:06.196096 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-017d217f-cb64-419f-a305-a35b7261395b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1272 microversion: 2.1 time: 0.133247 Sep 07 13:18:06.196662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 100/206] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:06 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:06.266798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:06.267948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:06.279098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.279915 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.280597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.282001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.283147 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.284130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.642246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:06.655803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9c41c20b-3734-493e-904b-9573c09e7674 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.396602 Sep 07 13:18:06.667174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 107/207] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:06 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:06.718503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:06.719422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:06.731034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.731713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.733034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.734045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.734693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.735141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:07.115254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:07.126039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cdcfac8e-d163-4f24-8f09-d524ddb7f194 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1553 microversion: 2.1 time: 0.414866 Sep 07 13:18:07.137308 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 101/208] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:06 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1553 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:07.220982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:07.221646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:07.227685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:07.228171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:07.228599 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:07.229287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:07.229731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:07.230154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:07.694645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:07.695449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:07.703620 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:07.704038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:07.704476 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:07.705197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:07.705652 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:07.706106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:07.854540 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:07.877650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-685f3f8a-82c1-4660-9208-b54bca66ced2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.660563 Sep 07 13:18:07.879483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 108/209] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:07 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:07.902470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-e03fda4e-0ceb-4959-a165-a1d85ec5ec1b req-b7510f0b-9249-4a86-b4a5-37a6a386ce8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e020bf09-5375-498a-b72c-4467376b0b7c", "name": "network-vif-deleted", "tag": "2e0f07aa-fa54-42a6-98a3-af1a44859d05"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:07.919409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e03fda4e-0ceb-4959-a165-a1d85ec5ec1b req-b7510f0b-9249-4a86-b4a5-37a6a386ce8b service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:07.920341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e03fda4e-0ceb-4959-a165-a1d85ec5ec1b req-b7510f0b-9249-4a86-b4a5-37a6a386ce8b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:07.921041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e03fda4e-0ceb-4959-a165-a1d85ec5ec1b req-b7510f0b-9249-4a86-b4a5-37a6a386ce8b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:07.942134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-e03fda4e-0ceb-4959-a165-a1d85ec5ec1b req-b7510f0b-9249-4a86-b4a5-37a6a386ce8b service nova] Creating event network-vif-deleted:2e0f07aa-fa54-42a6-98a3-af1a44859d05 for instance e020bf09-5375-498a-b72c-4467376b0b7c on hv-cinder-80403 Sep 07 13:18:07.950031 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-e03fda4e-0ceb-4959-a165-a1d85ec5ec1b req-b7510f0b-9249-4a86-b4a5-37a6a386ce8b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068875 Sep 07 13:18:07.952532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 109/210] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:08.034482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:08.043255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-58270428-5957-4640-a47b-8e141d8263d7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.354336 Sep 07 13:18:08.043825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 102/211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:07 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:08.151921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:08.152985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:08.165003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.165764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.166401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:08.167137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.167771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.168596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:08.282648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:08.293054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d66b4261-7cba-4c36-9d51-c2ec1a0e1907 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1345 microversion: 2.1 time: 0.146855 Sep 07 13:18:08.293644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 110/212] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:08 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:08.904939 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:08.905592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:08.912281 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.912785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.913996 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:08.914819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.915580 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.915853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.067822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:09.068506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:09.075417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.075907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.076347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.077084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.077541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.077965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.098303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:09.128982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=6 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:09.145579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:09.160220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f11f54a9-3fd3-4e48-94a0-df764e4b2753 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.256121 Sep 07 13:18:09.160220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 103/213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:08 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:09.317229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:09.317871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:09.317991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:09.320530 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:09.326587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.327078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.327207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f2960fd5-a5f0-4851-a5ef-e6adbc233abc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.263264 Sep 07 13:18:09.327546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.327755 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 111/214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:09 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:09.336458 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.336458 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.336458 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.368229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.368723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.369164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.369617 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lazy-loading 'fault' on Instance uuid e020bf09-5375-498a-b72c-4467376b0b7c {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:09.419016 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf718a19fbc9458c996678ed7accc344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43169ae236d4341abb683010449c5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:09.430088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bfb26061-6f9d-4e74-86f6-efbf7d28ec61 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 200 len: 1350 microversion: 2.1 time: 0.116810 Sep 07 13:18:09.430656 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 104/215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:09 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 1350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:09.976180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-6b835858-df2c-4104-88c6-693aead12a9c req-5bb49cd8-bbe5-4542-a735-76ef7e37aa79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f190c5ae-8f30-408b-b22e-54f97af49b87", "tag": "92cc99ba-324f-49be-9487-ecd8eb003e41"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:09.985712 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b835858-df2c-4104-88c6-693aead12a9c req-5bb49cd8-bbe5-4542-a735-76ef7e37aa79 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.986191 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b835858-df2c-4104-88c6-693aead12a9c req-5bb49cd8-bbe5-4542-a735-76ef7e37aa79 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.986625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b835858-df2c-4104-88c6-693aead12a9c req-5bb49cd8-bbe5-4542-a735-76ef7e37aa79 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.999040 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-6b835858-df2c-4104-88c6-693aead12a9c req-5bb49cd8-bbe5-4542-a735-76ef7e37aa79 service nova] Creating event network-changed:92cc99ba-324f-49be-9487-ecd8eb003e41 for instance f190c5ae-8f30-408b-b22e-54f97af49b87 on hv-cinder-80403 Sep 07 13:18:10.004155 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-6b835858-df2c-4104-88c6-693aead12a9c req-5bb49cd8-bbe5-4542-a735-76ef7e37aa79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032183 Sep 07 13:18:10.004766 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 112/216] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:10.198176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:10.198936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:10.205939 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.206426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.206869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.207607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.208059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.208480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.349542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:10.353321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:10.354032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:10.361278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.362057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ba1e9da2-4ab4-4b24-b4f1-0ff3e9ee500e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.168007 Sep 07 13:18:10.362201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.362504 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.362752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 105/217] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:10 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:10.363329 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.363850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.364443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.455400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:10.456046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:10.464834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.465520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.465946 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.466651 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.467126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.467541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.483348 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] HTTP exception thrown: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Request method failure captured: Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c HTTP/1.1 Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm2sVNvrp2H3eg7HaeqZEFiCvf_4fHN3eUsMYOC-sSwnCKG0F4955JH8y-oNGa1uqYI6gk6oxEW_agZHiufjcSYPctDtIMA3DLb-AMy1yc9BgMZzaT9EMQNnraPN_oSwBTGDGd4uOI3Sl60Mv77tCiNKzbD_Yq5dbUAZGOp1UDz84s Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:18:10.489088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d43169ae236d4341abb683010449c5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d43169ae236d4341abb683010449c5e2"}]}] Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: cf718a19fbc9458c996678ed7accc344 Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.490295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': 'e020bf09-5375-498a-b72c-4467376b0b7c'} Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:10.491040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.492195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.494445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Returning 404 to user: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:10.494445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e2098fce-9ebb-4a0a-abe5-ae81baba8cf6 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 404 len: 111 microversion: 2.1 time: 0.040234 Sep 07 13:18:10.502930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 106/218] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:10 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:18:10.510508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:10.524903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8f0cdf46-8d2a-4443-814b-efaee128440d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.176413 Sep 07 13:18:10.541749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 113/219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:10 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:10.621802 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:10.624250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:10.632703 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.633422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.633945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.635348 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.636049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.636591 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.657213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] HTTP exception thrown: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Request method failure captured: Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c/os-volume_attachments HTTP/1.1 Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm2sVNvrp2H3eg7HaeqZEFiCvf_4fHN3eUsMYOC-sSwnCKG0F4955JH8y-oNGa1uqYI6gk6oxEW_agZHiufjcSYPctDtIMA3DLb-AMy1yc9BgMZzaT9EMQNnraPN_oSwBTGDGd4uOI3Sl60Mv77tCiNKzbD_Yq5dbUAZGOp1UDz84s Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:18:10.658779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d43169ae236d4341abb683010449c5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d43169ae236d4341abb683010449c5e2"}]}] Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: cf718a19fbc9458c996678ed7accc344 Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.660830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'server_id': 'e020bf09-5375-498a-b72c-4467376b0b7c'} Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:10.661553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:10.662623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:10.663855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Returning 404 to user: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:10.663855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-512c85b4-5578-4cb5-806e-48dde28c0af5 tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042741 Sep 07 13:18:10.663855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 107/220] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:10 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:11.387568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:11.388310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:11.400115 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.400609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.403591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.404700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.405180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.405610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.553163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:11.554296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:11.575034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.576267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.577395 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.580125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.581257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.582305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.663522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:11.676107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d9dd756b-3a43-45ed-9c3c-b4f779d2185b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.294264 Sep 07 13:18:11.694196 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 114/221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:11 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:11.825422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:11.838996 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-42d293e0-37e0-4473-b094-1378141d83aa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.292598 Sep 07 13:18:11.839721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 108/222] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:11 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:11.935556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:11.936763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:11.949226 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.949959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.950616 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.951574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.952612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.953475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.001425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] HTTP exception thrown: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Request method failure captured: Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c HTTP/1.1 Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJm2sVNvrp2H3eg7HaeqZEFiCvf_4fHN3eUsMYOC-sSwnCKG0F4955JH8y-oNGa1uqYI6gk6oxEW_agZHiufjcSYPctDtIMA3DLb-AMy1yc9BgMZzaT9EMQNnraPN_oSwBTGDGd4uOI3Sl60Mv77tCiNKzbD_Yq5dbUAZGOp1UDz84s Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:18:12.007807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d43169ae236d4341abb683010449c5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d43169ae236d4341abb683010449c5e2"}]}] Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: cf718a19fbc9458c996678ed7accc344 Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.009321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'e020bf09-5375-498a-b72c-4467376b0b7c'} Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:12.010389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.011803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.012945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Returning 404 to user: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:12.012945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-80a0b9b4-7f39-4367-ac45-7132b58dbdbb tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 404 len: 111 microversion: 2.1 time: 0.079091 Sep 07 13:18:12.012945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 115/223] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:11 2022] DELETE /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:12.029615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:12.032891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] [instance: e020bf09-5375-498a-b72c-4467376b0b7c] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:12.043339 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.043835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.044270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.044977 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.045427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.051945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.070531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] HTTP exception thrown: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Request method failure captured: Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c HTTP/1.1 Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm2sVNvrp2H3eg7HaeqZEFiCvf_4fHN3eUsMYOC-sSwnCKG0F4955JH8y-oNGa1uqYI6gk6oxEW_agZHiufjcSYPctDtIMA3DLb-AMy1yc9BgMZzaT9EMQNnraPN_oSwBTGDGd4uOI3Sl60Mv77tCiNKzbD_Yq5dbUAZGOp1UDz84s Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:18:12.072516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d43169ae236d4341abb683010449c5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d43169ae236d4341abb683010449c5e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d43169ae236d4341abb683010449c5e2"}]}] Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: d43169ae236d4341abb683010449c5e2 Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-DeleteServersTestJSON-606639908 Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: cf718a19fbc9458c996678ed7accc344 Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-DeleteServersTestJSON-606639908-project Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.073696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': 'e020bf09-5375-498a-b72c-4467376b0b7c'} Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:12.074427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. Sep 07 13:18:12.075503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:12.077492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] Returning 404 to user: Instance e020bf09-5375-498a-b72c-4467376b0b7c could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:12.078564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-43e9a4ff-7d19-4b62-980f-11fba625291a tempest-DeleteServersTestJSON-606639908 tempest-DeleteServersTestJSON-606639908-project] 10.222.0.61 "GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c" status: 404 len: 111 microversion: 2.1 time: 0.063517 Sep 07 13:18:12.079152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 109/224] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:12 2022] GET /compute/v2.1/servers/e020bf09-5375-498a-b72c-4467376b0b7c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:12.703270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:12.704066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:12.713285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.715884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.717154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.720696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.721436 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.721894 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.866508 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:12.867305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:12.876198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.876806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.877678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.878560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.883027 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.883593 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:13.154946 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:13.167604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cc5ae1a4-083b-4217-b984-2b9f4bbfb565 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.469957 Sep 07 13:18:13.168797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 116/225] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:12 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:13.366256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:13.380881 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-79b6482d-69d1-4325-887d-94418d757188 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.518929 Sep 07 13:18:13.382902 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 110/226] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:12 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:14.195322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:14.201005 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:14.207951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:14.208713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:14.209464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:14.210498 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:14.210953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:14.211403 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:14.216097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:14.400461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:14.409547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:14.410194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:14.413953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3e447436-91bf-4a1c-9849-3136d5ecbcf4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.225588 Sep 07 13:18:14.414541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 117/227] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:14 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:14.423027 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:14.423554 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:14.423981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:14.425028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:14.425361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:14.425754 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:14.710234 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:14.743721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5bbd0eaf-7892-4329-9318-b0018ecf5920 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.338773 Sep 07 13:18:14.759422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 111/228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:14 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:15.440742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:15.441892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:15.458704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.460068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.460665 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.461672 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.462374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.463030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.620260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-c339ec52-3948-477a-8110-f62fa5b339cd req-67f23305-a8b3-40d9-ad4a-086ac3f4720b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f190c5ae-8f30-408b-b22e-54f97af49b87", "name": "network-vif-plugged", "status": "completed", "tag": "92cc99ba-324f-49be-9487-ecd8eb003e41"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:15.641575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-c339ec52-3948-477a-8110-f62fa5b339cd req-67f23305-a8b3-40d9-ad4a-086ac3f4720b service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.642055 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-c339ec52-3948-477a-8110-f62fa5b339cd req-67f23305-a8b3-40d9-ad4a-086ac3f4720b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.642532 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-c339ec52-3948-477a-8110-f62fa5b339cd req-67f23305-a8b3-40d9-ad4a-086ac3f4720b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.665699 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-c339ec52-3948-477a-8110-f62fa5b339cd req-67f23305-a8b3-40d9-ad4a-086ac3f4720b service nova] Creating event network-vif-plugged:92cc99ba-324f-49be-9487-ecd8eb003e41 for instance f190c5ae-8f30-408b-b22e-54f97af49b87 on hv-cinder-80403 Sep 07 13:18:15.682559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-c339ec52-3948-477a-8110-f62fa5b339cd req-67f23305-a8b3-40d9-ad4a-086ac3f4720b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064944 Sep 07 13:18:15.684166 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 112/229] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:15.773914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:15.774604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:15.792909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.794139 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.804023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.805165 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.805904 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.806334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.982305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:15.996679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d15ec4f2-e611-4b2f-a070-6b44df4d6b41 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.560260 Sep 07 13:18:15.997649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 118/230] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:15 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:16.123169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:16.136382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d8c10517-0abc-4eaf-ae07-aa55c64fd695 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.367254 Sep 07 13:18:16.140570 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 113/231] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:15 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:17.023321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:17.024217 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:17.043080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.043080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.043080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.043080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.043409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.043409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.168843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:17.169582 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:17.190493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.193852 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.195484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.198457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.200293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.201322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.342154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:17.353798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a7b7e5bd-8c97-4cff-865c-6865816fa8d7 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.335323 Sep 07 13:18:17.354859 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 119/232] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:17 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:17.431752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:17.440550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cc1c99a7-c9e4-4505-9ea4-aea1a3435e48 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.275801 Sep 07 13:18:17.441856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 114/233] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:17 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:18.379451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:18.380210 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:18.388001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.388633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.389898 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.390792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.391428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.391858 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.471697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:18.472334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:18.480030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.480757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.481188 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.482330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.482803 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.483284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.488285 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:18.593759 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:18.613775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8ce1f0c8-82a0-41f9-a907-d0b5409c8b25 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.239458 Sep 07 13:18:18.614611 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 120/234] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:18 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:18.663150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:18.671792 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-44d15b00-660f-40e1-8ec4-8b9f672587dc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.204168 Sep 07 13:18:18.672865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 115/235] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:18 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:19.356613 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cdbe4dd5-93df-4e91-b1a7-72e247c0dd1f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Action: 'create', calling method: .version_select at 0x7fa3db869b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-483544866"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:19.638698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:19.639435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:19.647285 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:19.647828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:19.648221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:19.648940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:19.649394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:19.649816 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:19.752341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cdbe4dd5-93df-4e91-b1a7-72e247c0dd1f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.535213 Sep 07 13:18:19.757980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 121/236] 10.222.0.61 () {60 vars in 1155 bytes} [Wed Sep 7 13:18:19 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 537 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 07 13:18:19.758855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:19.758855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:19.767810 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:19.768556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:19.769234 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:19.769962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:19.770428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:19.770863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:19.848498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:19.857664 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0e37128c-06cf-4489-bd63-a6a5cea14b1a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.222773 Sep 07 13:18:19.858268 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 116/237] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:19 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:19.863213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ae9e9190-8e3f-4049-a12b-df32222dec5f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db791dc0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:19.923548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ae9e9190-8e3f-4049-a12b-df32222dec5f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 200 len: 344 microversion: 2.1 time: 0.064156 Sep 07 13:18:19.924126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 117/238] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:19 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:19.927985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:19.935975 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-60af3f19-f1d1-450a-a0b3-25fe5f0eb984 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.181737 Sep 07 13:18:19.936555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 122/239] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:19 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:20.887464 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:20.889167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:20.895446 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:20.895947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:20.896396 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:20.897104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:20.897551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:20.897975 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:20.937617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-02b0460c-1b73-4986-9df7-e6b9303b1f96 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db95ce50>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:20.989708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-02b0460c-1b73-4986-9df7-e6b9303b1f96 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 200 len: 344 microversion: 2.1 time: 0.055749 Sep 07 13:18:20.990824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 123/240] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:20 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:20.995428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:20.996043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:21.001951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.002444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.002882 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.003611 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.004063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.004490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.034686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:21.043843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-947797da-0dfa-4a8e-958b-a17eb19cef33 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.164455 Sep 07 13:18:21.044419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 118/241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:20 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:21.144688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:21.152648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-da122a33-dfb5-447d-8f1c-ba763224b07e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.160803 Sep 07 13:18:21.153325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 124/242] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:20 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:22.004486 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-91ed0bd6-87ad-457d-9821-aa57f6f84e7b tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db791d30>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:22.055303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-91ed0bd6-87ad-457d-9821-aa57f6f84e7b tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 200 len: 344 microversion: 2.1 time: 0.054568 Sep 07 13:18:22.055889 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 119/243] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:21 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:22.067863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:22.068494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:22.075250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:22.075754 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:22.076190 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:22.076903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:22.077352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:22.077776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:22.177504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:22.178882 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:22.182162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=66 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:22.189548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:22.190019 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:22.190462 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:22.191208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:22.192828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:22.193474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:22.226777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:22.237245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9ed406f3-dd86-4465-9055-9dd9037639e5 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1314 microversion: 2.1 time: 0.173576 Sep 07 13:18:22.237974 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 125/244] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:22 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:22.488861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:22.497427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-66ad12f2-3e96-4567-b5ab-e469b8059222 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.324985 Sep 07 13:18:22.498056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 120/245] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:22 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:23.070503 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-90e8098e-538c-4d91-9a60-d5bc9d989b54 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db877670>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:23.118859 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-90e8098e-538c-4d91-9a60-d5bc9d989b54 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 200 len: 344 microversion: 2.1 time: 0.052722 Sep 07 13:18:23.119550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 126/246] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:23 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:23.263651 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:23.264264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:23.270942 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.272125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.272636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.273398 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.273920 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.274408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.414565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:23.422343 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-10ea0efb-aafc-4d31-83c5-99537fbb8b00 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1496 microversion: 2.1 time: 0.162532 Sep 07 13:18:23.422914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 121/247] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:23 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:23.521074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:23.522349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:23.528486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.528963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.529392 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.530081 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.530532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.530974 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.667818 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:23.675493 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6dec0d62-dece-4a0e-841a-f042214928f3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.158351 Sep 07 13:18:23.676063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 127/248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:23 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:24.133868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e3b51124-5de5-46c3-8b36-24ca6d526e73 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db8a6160>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:24.188120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e3b51124-5de5-46c3-8b36-24ca6d526e73 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 200 len: 344 microversion: 2.1 time: 0.058663 Sep 07 13:18:24.188847 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 122/249] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:24 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:24.698640 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:24.699196 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:24.705158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:24.705602 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:24.706037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:24.706730 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:24.707216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:24.707647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:24.845716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:24.854142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-22060aea-f7ec-43b9-bdb6-c23424ac6cdd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.159328 Sep 07 13:18:24.854661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 128/250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:24 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:25.212026 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-26092d9e-af47-4f6a-8022-006c90d8c501 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db791280>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:25.305704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-26092d9e-af47-4f6a-8022-006c90d8c501 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 200 len: 345 microversion: 2.1 time: 0.098865 Sep 07 13:18:25.306346 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 123/251] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:25 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:25.322058 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c9025799-3632-4ec4-88b8-8346e185aa9d tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Action: 'create', calling method: .version_select at 0x7fa3db8873a0>, body: {"snapshot": {"volume_id": "7e0abcc3-11ae-46a9-8124-29d9a6249c59", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1432567791"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:25.536629 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c9025799-3632-4ec4-88b8-8346e185aa9d tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.220076 Sep 07 13:18:25.550964 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 129/252] 10.222.0.61 () {60 vars in 1162 bytes} [Wed Sep 7 13:18:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:25.558550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e9248310-954e-4fcb-9f4c-c7e1db12eee4 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db791c10>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:25.598954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e9248310-954e-4fcb-9f4c-c7e1db12eee4 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.046368 Sep 07 13:18:25.600176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 124/253] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:25 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:25.612963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e43cd18b-6b8a-4128-a373-840524097b93 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db877e50>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:25.645250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e43cd18b-6b8a-4128-a373-840524097b93 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037151 Sep 07 13:18:25.646014 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 130/254] 10.222.0.61 () {58 vars in 1140 bytes} [Wed Sep 7 13:18:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:25.657707 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7173b3b8-aa90-4604-a484-8fd39c6e8640 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db8ff5e0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:25.688137 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7173b3b8-aa90-4604-a484-8fd39c6e8640 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.034081 Sep 07 13:18:25.688901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 125/255] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:25 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:25.876978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:25.877587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:25.885186 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:25.885779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:25.886342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:25.887067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:25.887550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:25.887984 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.024295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:26.032013 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d0ddf9a4-5313-4df6-838a-fc1aed2728ac tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.158984 Sep 07 13:18:26.032581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 131/256] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:25 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:26.702535 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-404342f5-3e4b-4a77-a1e3-f65c09c39ec9 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db791a60>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:26.732201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-404342f5-3e4b-4a77-a1e3-f65c09c39ec9 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.033762 Sep 07 13:18:26.732777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 126/257] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:26 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:27.054832 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:27.055472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:27.061433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.061913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.062347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.063047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.063525 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.063951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.195786 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:27.203561 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-508ccd6b-bb5e-421f-97f8-d8a0deab2979 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.152453 Sep 07 13:18:27.204158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 132/258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:27 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:27.746184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7246e6ea-a785-43b3-94d1-04bab035aa5e tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db895d30>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:27.776747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7246e6ea-a785-43b3-94d1-04bab035aa5e tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.034879 Sep 07 13:18:27.777347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 127/259] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:27 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:28.227261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:28.228285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:28.235392 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.235921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:28.236363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:28.237096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.237551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:28.237980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:28.376338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:28.384078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-86cce19e-b8a0-4c7d-b625-decaba747c38 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.160723 Sep 07 13:18:28.384658 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 133/260] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:28 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:28.789865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-73e7295d-6f7c-44f2-8f1e-2181f236e95f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db791af0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:28.820164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-73e7295d-6f7c-44f2-8f1e-2181f236e95f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.034607 Sep 07 13:18:28.820750 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 128/261] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:28 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:29.407411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:29.408056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:29.414249 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.414760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.415230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.415927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.416380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.416831 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.553056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:29.561033 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2bfe207d-d43d-439e-9b04-7c7f6139289e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.157572 Sep 07 13:18:29.561614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 134/262] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:29 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:29.722802 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:29.723345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:29.729759 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.730243 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.730682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.731413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.732141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.732563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.763201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:29.836270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-726205be-75cb-4b87-b940-52a71786f6f6 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db887040>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:29.863313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-00a727a7-951c-4706-b6b4-f274ad05e873 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 204 len: 0 microversion: 2.1 time: 0.143773 Sep 07 13:18:29.863974 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 129/263] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:29 2022] DELETE /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:18:29.874653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:29.875410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:29.883412 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-726205be-75cb-4b87-b940-52a71786f6f6 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.053955 Sep 07 13:18:29.883871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.888757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.888950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 135/264] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:29 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:29.889049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.889049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.889049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.889049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:30.056563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:30.064469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fcef1f0a-76df-4b96-a388-3eef13a5cedd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.195472 Sep 07 13:18:30.065054 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 130/265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:29 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:30.588323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:30.588937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:30.594940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:30.595465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:30.595912 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:30.596627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:30.597086 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:30.597517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:30.736554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:30.744774 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5099da91-e657-4403-80dc-9018d079d0c1 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.160641 Sep 07 13:18:30.745451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 136/266] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:30 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:30.897906 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-11a7474d-00d2-4618-af9c-d0d90f83b485 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db9a6160>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:30.928885 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-11a7474d-00d2-4618-af9c-d0d90f83b485 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.036262 Sep 07 13:18:30.929463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 131/267] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:30 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:31.088419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:31.089036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:31.095030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.095557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.095997 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.096705 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.097161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.097588 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.236650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:31.246740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c8698645-2b41-4c60-a931-cac771a1ca20 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.160391 Sep 07 13:18:31.247322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 137/268] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:31 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:31.768909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:31.769516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:31.776335 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.776829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.777266 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.777971 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.778417 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.778842 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.919716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:31.929050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8b7e806e-823c-4b02-9a56-9910a29c124b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.163988 Sep 07 13:18:31.931880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 132/269] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:31 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:31.941496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c1c8c562-a0ee-4e20-a86a-160e7cf75cf2 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db8774c0>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:31.973401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c1c8c562-a0ee-4e20-a86a-160e7cf75cf2 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.035590 Sep 07 13:18:31.974023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 138/270] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:31 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:32.270400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:32.271445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:32.277837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.278322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.278980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.279711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.280292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.280717 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.417141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:32.425251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-485a585d-ee90-41e1-8b23-116af8192ba3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.158535 Sep 07 13:18:32.426318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 133/271] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:32 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:32.957287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:32.958514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:32.969474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.970293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.971067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.972354 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.973186 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.974024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.986778 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8ccaa4c1-809d-4d0b-8f6f-b950fcaf5c3b tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db791940>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:33.019254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8ccaa4c1-809d-4d0b-8f6f-b950fcaf5c3b tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.036534 Sep 07 13:18:33.019819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 134/272] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:32 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:33.131397 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:33.139879 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-aa3b381e-106f-44f1-b0e6-66e0bdb028a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.190163 Sep 07 13:18:33.140466 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 139/273] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:32 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:33.449682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:33.450293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:33.456455 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.456941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.457376 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.458675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.459159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.459619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.596127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:33.604437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5fa213e9-9e69-40de-9435-2ca20ad48fa1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.158635 Sep 07 13:18:33.605141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 135/274] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:33 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:34.032266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-579e5cbb-2fbe-44a5-b4e9-d2a25a1ed308 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db877430>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:34.063193 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-579e5cbb-2fbe-44a5-b4e9-d2a25a1ed308 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.034818 Sep 07 13:18:34.063755 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 140/275] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:34 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:34.164310 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:34.165070 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:34.171891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.172386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.172824 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.173525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.173982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.174410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.312762 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:34.320685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b8112644-e08b-4323-8e1c-9919dedd56bb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.160838 Sep 07 13:18:34.321255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 136/276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:34 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:34.628689 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:34.629173 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:34.636046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.636530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.636962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.637650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.638098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.638516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.775690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:34.779069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:34.784214 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d8ab218a-8119-419e-b2dd-9bce782abd15 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.159506 Sep 07 13:18:34.784794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 141/277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:34 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:35.079870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-adcd037a-c590-4a1a-952e-1eeb5f952db5 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db8ff8b0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.113770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-adcd037a-c590-4a1a-952e-1eeb5f952db5 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 288 microversion: 2.1 time: 0.038375 Sep 07 13:18:35.115449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 137/278] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:35 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:35.130708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-23ad2824-0e5c-46b9-ac02-fd9dd956a59f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db877940>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.214106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-23ad2824-0e5c-46b9-ac02-fd9dd956a59f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 202 len: 0 microversion: 2.1 time: 0.087912 Sep 07 13:18:35.214776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 142/279] 10.222.0.61 () {58 vars in 1254 bytes} [Wed Sep 7 13:18:35 2022] DELETE /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:35.223507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9a41f80b-d054-4035-9207-ba11ef6d8a8a tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db95b280>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.256697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9a41f80b-d054-4035-9207-ba11ef6d8a8a tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.037374 Sep 07 13:18:35.257540 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 138/280] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:35 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:35.346805 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.347445 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:35.354160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.354647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.355087 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.355834 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.356269 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.357081 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.503126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:35.512219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-05091dee-71fd-41d9-9c17-f118d643fa3b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.169213 Sep 07 13:18:35.512906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 143/281] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:35 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:35.808131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.808775 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:35.815538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.816036 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.816484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.817223 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.818225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.818654 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.978738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:35.987176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d01f487e-994e-447a-8f83-9d1a46a20b97 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.182899 Sep 07 13:18:35.987763 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 139/282] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:35 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:36.269927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b53a1c94-cd28-4e2a-ad39-31dcbeb83c9c tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db877280>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.301680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b53a1c94-cd28-4e2a-ad39-31dcbeb83c9c tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.035432 Sep 07 13:18:36.302257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 144/283] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:36 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:36.537354 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.537963 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.544813 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.545319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.545763 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.546468 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.546936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.547381 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.715423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:36.723516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c858281c-c676-4c04-baf4-e07976308fd8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.191172 Sep 07 13:18:36.724632 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 140/284] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:36 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:37.011952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.012552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:37.014459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=58 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:37.019762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.020243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.021242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.021939 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.022385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.022803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.173194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:37.181622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-42685eeb-0d41-4f71-b34e-f0438d582ea8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.173451 Sep 07 13:18:37.182196 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 145/285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:37 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:37.314020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ae09e41f-6015-4a6b-8cef-b30029055200 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db8a64c0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.344635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ae09e41f-6015-4a6b-8cef-b30029055200 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.034372 Sep 07 13:18:37.345278 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 141/286] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:37 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:37.747681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.748219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:37.755690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.756661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.757171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.757951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.758511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.759076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.899876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:37.908430 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8877acb5-f2d1-40e6-9415-8072fb8d08ba tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.164865 Sep 07 13:18:37.909008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 146/287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:37 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:38.206588 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.207175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.213235 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.213718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.214153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.214845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.215334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.215755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.355550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:38.359155 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-eab25e15-14e5-4ed9-b8bd-336bb0b3ce95 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db869ee0>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.365164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fa08dad9-9571-4763-9676-733c338b2f35 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.162909 Sep 07 13:18:38.365744 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 142/288] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:38 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:38.393387 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-eab25e15-14e5-4ed9-b8bd-336bb0b3ce95 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.038972 Sep 07 13:18:38.393947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 147/289] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:38 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:38.931580 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.932209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.938128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.938613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.939050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.939761 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.940216 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.940637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.074260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:39.082505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4b1eaf17-59de-4848-bff5-f65be591b192 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.154859 Sep 07 13:18:39.083087 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 143/290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:38 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:39.391382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.394314 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.404598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.405095 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.405537 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.406247 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.408597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-41030d86-a922-48ca-96ce-72b588090b26 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db8085e0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.411474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.412067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.440801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-41030d86-a922-48ca-96ce-72b588090b26 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 200 len: 287 microversion: 2.1 time: 0.038073 Sep 07 13:18:39.441418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 144/291] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:39.546090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:39.555020 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fc37dfa1-5198-4942-8550-2b5e47d789b1 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.169896 Sep 07 13:18:39.555631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 148/292] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:40.109593 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.110204 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:40.116230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.116725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.117162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.117861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.118422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.118849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.123216 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:40.258909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:40.266599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-33b99020-4533-4747-8f49-a58646672f6f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.161312 Sep 07 13:18:40.267192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 145/293] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:40 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:40.459659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9010c8fe-896a-4e9f-9eea-e6e4aae00794 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3dba9a8b0>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.498772 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-9010c8fe-896a-4e9f-9eea-e6e4aae00794 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] HTTP exception thrown: Snapshot 90dfe298-44a7-476e-9891-74a055342b9e could not be found. Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9010c8fe-896a-4e9f-9eea-e6e4aae00794 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Request method failure captured: Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e HTTP/1.1 Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJob4TSvXzX1KwXqZVFxqAiwfnc9mNY5lVJA9hCJ9l6XjFxxIWf3wXsK4MlMlxpZsqdJP1lhPL4N4pDYCgNwfeFcTOtslO8-_L4Jwrf1F2V3UjPliMQVzkIC3YwiRVNHHPw43oEf8LbpLaLxjHWPBVUi7Wa3StNz-LeeMKjfFTdHw5I Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:18:40.501505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/34baa8df19ad40dfa447ef4f6ee35969"}]}] Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 63b9687eeb3c45fe98808a0ebda40044 Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Snapshot 90dfe298-44a7-476e-9891-74a055342b9e could not be found. Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '90dfe298-44a7-476e-9891-74a055342b9e'} Sep 07 13:18:40.502853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 90dfe298-44a7-476e-9891-74a055342b9e could not be found. (HTTP 404) (Request-ID: req-1b783a6f-3e49-4bc6-8098-f9005b4d2fef) Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.503659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:18:40.504763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 90dfe298-44a7-476e-9891-74a055342b9e could not be found. Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 13:18:40.506048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 90dfe298-44a7-476e-9891-74a055342b9e could not be found. Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 90dfe298-44a7-476e-9891-74a055342b9e could not be found. Sep 07 13:18:40.507225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.509664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9010c8fe-896a-4e9f-9eea-e6e4aae00794 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Returning 404 to user: Snapshot 90dfe298-44a7-476e-9891-74a055342b9e could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:40.510674 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9010c8fe-896a-4e9f-9eea-e6e4aae00794 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e" status: 404 len: 111 microversion: 2.1 time: 0.059731 Sep 07 13:18:40.511550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 149/294] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:40 2022] GET /compute/v2.1/os-snapshots/90dfe298-44a7-476e-9891-74a055342b9e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:40.523082 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-31f689d2-d262-4714-93d6-b2f83668557f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db8085e0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.581291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.583427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:40.594510 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.595067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.595722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.596603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.597211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.597681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.605474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-31f689d2-d262-4714-93d6-b2f83668557f tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 202 len: 0 microversion: 2.1 time: 0.089155 Sep 07 13:18:40.606072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 146/295] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:18:40 2022] DELETE /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:40.614621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b28d23b6-5300-4d8a-a7be-ab8ae761a3fc tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db895820>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.677452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b28d23b6-5300-4d8a-a7be-ab8ae761a3fc tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 200 len: 344 microversion: 2.1 time: 0.066547 Sep 07 13:18:40.678067 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 147/296] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:40 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:40.815566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:40.825983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-186532e6-067d-4185-bbfb-b2c788eaf8ed tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1502 microversion: 2.1 time: 0.250097 Sep 07 13:18:40.841519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 150/297] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:40 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:40.949438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-05b43f4d-28ff-4f35-86e1-4a06b655dcc8 req-103da560-8383-444d-9a51-98c5309340d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f190c5ae-8f30-408b-b22e-54f97af49b87", "name": "network-vif-deleted", "tag": "92cc99ba-324f-49be-9487-ecd8eb003e41"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:40.965168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-05b43f4d-28ff-4f35-86e1-4a06b655dcc8 req-103da560-8383-444d-9a51-98c5309340d8 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.965670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-05b43f4d-28ff-4f35-86e1-4a06b655dcc8 req-103da560-8383-444d-9a51-98c5309340d8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.966084 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-05b43f4d-28ff-4f35-86e1-4a06b655dcc8 req-103da560-8383-444d-9a51-98c5309340d8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.981687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-05b43f4d-28ff-4f35-86e1-4a06b655dcc8 req-103da560-8383-444d-9a51-98c5309340d8 service nova] Creating event network-vif-deleted:92cc99ba-324f-49be-9487-ecd8eb003e41 for instance f190c5ae-8f30-408b-b22e-54f97af49b87 on hv-cinder-80403 Sep 07 13:18:40.999833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-05b43f4d-28ff-4f35-86e1-4a06b655dcc8 req-103da560-8383-444d-9a51-98c5309340d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058973 Sep 07 13:18:41.000773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 148/298] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:41.297235 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:41.298567 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:41.306332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:41.307225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:41.308119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:41.309049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:41.309515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:41.310207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:41.480223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:41.495307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d8ab99c4-2c36-4140-b0aa-611023e5fc58 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.206689 Sep 07 13:18:41.499292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 151/299] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:41 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:41.694238 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3cc1f139-3a52-4f6b-8718-c9f6e9bda0a1 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db7e2ee0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:41.725734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-3cc1f139-3a52-4f6b-8718-c9f6e9bda0a1 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] HTTP exception thrown: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3cc1f139-3a52-4f6b-8718-c9f6e9bda0a1 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Request method failure captured: Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 HTTP/1.1 Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJob4TSvXzX1KwXqZVFxqAiwfnc9mNY5lVJA9hCJ9l6XjFxxIWf3wXsK4MlMlxpZsqdJP1lhPL4N4pDYCgNwfeFcTOtslO8-_L4Jwrf1F2V3UjPliMQVzkIC3YwiRVNHHPw43oEf8LbpLaLxjHWPBVUi7Wa3StNz-LeeMKjfFTdHw5I Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:18:41.728347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/34baa8df19ad40dfa447ef4f6ee35969"}]}] Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 63b9687eeb3c45fe98808a0ebda40044 Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '7e0abcc3-11ae-46a9-8124-29d9a6249c59'} Sep 07 13:18:41.729494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. (HTTP 404) (Request-ID: req-405f2366-03d5-49ba-a597-f52519c80f83) Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.730201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:18:41.731492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:18:41.732489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3cc1f139-3a52-4f6b-8718-c9f6e9bda0a1 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Returning 404 to user: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3cc1f139-3a52-4f6b-8718-c9f6e9bda0a1 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 404 len: 109 microversion: 2.1 time: 0.040498 Sep 07 13:18:41.733491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 149/300] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:41 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:41.745051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-319f3b95-a1a9-4fc7-99c3-f46b0324f866 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db869160>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:41.777762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-319f3b95-a1a9-4fc7-99c3-f46b0324f866 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] HTTP exception thrown: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-319f3b95-a1a9-4fc7-99c3-f46b0324f866 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Request method failure captured: Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 HTTP/1.1 Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJob4TSvXzX1KwXqZVFxqAiwfnc9mNY5lVJA9hCJ9l6XjFxxIWf3wXsK4MlMlxpZsqdJP1lhPL4N4pDYCgNwfeFcTOtslO8-_L4Jwrf1F2V3UjPliMQVzkIC3YwiRVNHHPw43oEf8LbpLaLxjHWPBVUi7Wa3StNz-LeeMKjfFTdHw5I Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:18:41.780056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/34baa8df19ad40dfa447ef4f6ee35969"}]}] Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 63b9687eeb3c45fe98808a0ebda40044 Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '7e0abcc3-11ae-46a9-8124-29d9a6249c59'} Sep 07 13:18:41.781467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. (HTTP 404) (Request-ID: req-369f5fe5-5e20-4c4f-96fa-0abc82e17e61) Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.782211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:18:41.783377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:18:41.784425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-319f3b95-a1a9-4fc7-99c3-f46b0324f866 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Returning 404 to user: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-319f3b95-a1a9-4fc7-99c3-f46b0324f866 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 404 len: 109 microversion: 2.1 time: 0.040439 Sep 07 13:18:41.785440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 152/301] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:18:41 2022] DELETE /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:41.790667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-77e8a139-3131-48be-b9f4-983d601529b4 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Calling method '.version_select at 0x7fa3db808280>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:41.819805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-77e8a139-3131-48be-b9f4-983d601529b4 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] HTTP exception thrown: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-77e8a139-3131-48be-b9f4-983d601529b4 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Request method failure captured: Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 HTTP/1.1 Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJob4TSvXzX1KwXqZVFxqAiwfnc9mNY5lVJA9hCJ9l6XjFxxIWf3wXsK4MlMlxpZsqdJP1lhPL4N4pDYCgNwfeFcTOtslO8-_L4Jwrf1F2V3UjPliMQVzkIC3YwiRVNHHPw43oEf8LbpLaLxjHWPBVUi7Wa3StNz-LeeMKjfFTdHw5I Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:18:41.821770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/34baa8df19ad40dfa447ef4f6ee35969"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/34baa8df19ad40dfa447ef4f6ee35969"}]}] Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 34baa8df19ad40dfa447ef4f6ee35969 Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37384850 Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 63b9687eeb3c45fe98808a0ebda40044 Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37384850-project Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '7e0abcc3-11ae-46a9-8124-29d9a6249c59'} Sep 07 13:18:41.823208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. (HTTP 404) (Request-ID: req-f22e5a4d-e888-4e0b-a7ae-edb18f5a7223) Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.824079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:18:41.825432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:18:41.827074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-77e8a139-3131-48be-b9f4-983d601529b4 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] Returning 404 to user: Volume 7e0abcc3-11ae-46a9-8124-29d9a6249c59 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-77e8a139-3131-48be-b9f4-983d601529b4 tempest-VolumesSnapshotsTestJSON-37384850 tempest-VolumesSnapshotsTestJSON-37384850-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59" status: 404 len: 109 microversion: 2.1 time: 0.036299 Sep 07 13:18:41.828301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 150/302] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:41 2022] GET /compute/v2.1/os-volumes/7e0abcc3-11ae-46a9-8124-29d9a6249c59 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:41.853272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:41.853987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:41.863010 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:41.863826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:41.864474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:41.865656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:41.866349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:41.866786 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:41.905152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:41.905725 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:41.906364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:41.907037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lazy-loading 'fault' on Instance uuid f190c5ae-8f30-408b-b22e-54f97af49b87 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:41.962579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:41.970822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1423fcae-4f3b-4e93-a094-3f0e33f6d9bd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 200 len: 1304 microversion: 2.1 time: 0.121278 Sep 07 13:18:41.971635 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 153/303] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:41 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:42.521859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.522851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:42.530264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.531401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.532051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.533086 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.533928 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.534596 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.702097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:42.710878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6b5f70b2-f61f-48d3-b72a-7acda5d06379 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.194198 Sep 07 13:18:42.711542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 151/304] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:42 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:42.996728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.997334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: f190c5ae-8f30-408b-b22e-54f97af49b87] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:43.003445 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.003925 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.004863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.005586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.006030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.006444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.029415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] HTTP exception thrown: Instance f190c5ae-8f30-408b-b22e-54f97af49b87 could not be found. Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Request method failure captured: Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 HTTP/1.1 Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJoC7zr_EuCbGtrbNV70ItTsKUqFZKFulMxLowrs2qK2wgRaZiLqVN5toGJ3wzHRUOqQu_G4hB4OYSDsYQbXGzHBh_cF2xe4EPICXGoqVRv5NqY44t0h4ZfZ8pkVnCLDmopZO5IL5fO53gI8Vr7sHM-d5ose8MgEiTkLd_11AHlBCk8 Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 6d3b344911654d3a83328d54b8feca0e Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesActionsTest-1793814920 Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:18:43.037295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d3b344911654d3a83328d54b8feca0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d3b344911654d3a83328d54b8feca0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d3b344911654d3a83328d54b8feca0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d3b344911654d3a83328d54b8feca0e"}]}] Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesActionsTest-1793814920 Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 6d3b344911654d3a83328d54b8feca0e Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesActionsTest-1793814920 Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesActionsTest-1793814920-project Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 3f93418e3e264a1f8597f789ee888b4e Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesActionsTest-1793814920-project Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance f190c5ae-8f30-408b-b22e-54f97af49b87 could not be found. Sep 07 13:18:43.038515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'f190c5ae-8f30-408b-b22e-54f97af49b87'} Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f190c5ae-8f30-408b-b22e-54f97af49b87 could not be found. Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:43.039307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f190c5ae-8f30-408b-b22e-54f97af49b87 could not be found. Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f190c5ae-8f30-408b-b22e-54f97af49b87 could not be found. Sep 07 13:18:43.040519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.042638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Returning 404 to user: Instance f190c5ae-8f30-408b-b22e-54f97af49b87 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:43.042638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8afb5dcc-6d69-41c6-b095-462c969a6549 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87" status: 404 len: 111 microversion: 2.1 time: 0.051999 Sep 07 13:18:43.043277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 154/305] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:42 2022] GET /compute/v2.1/servers/f190c5ae-8f30-408b-b22e-54f97af49b87 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:18:43.182893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-568312485", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "networks": [{"uuid": "ad244cdf-4250-43dd-aa10-a3da69f80c40"}]}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:43.243503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] validate_networks() for [('ad244cdf-4250-43dd-aa10-a3da69f80c40', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:18:43.665387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:18:43.666380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:18:43.667062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:18:43.667844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:18:43.668480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:18:43.685443 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.686761 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.689223 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.690131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.690942 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.693168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.725940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Getting quotas for project 6d3b344911654d3a83328d54b8feca0e. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:18:43.747828 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:43.751413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Getting quotas for user 3f93418e3e264a1f8597f789ee888b4e and project 6d3b344911654d3a83328d54b8feca0e. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:18:43.752714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:43.768997 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:18:43.772341 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:18:43.777574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.778144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.778719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.782866 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.783266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.783712 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.845182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-de3e108e-75a8-4600-9949-bf3cb31025a6 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666069 Sep 07 13:18:43.846041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 152/306] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:18:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:18:43.862786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-37bed63f-8ae4-4309-a89f-3d113ec85d0e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:43.864286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-37bed63f-8ae4-4309-a89f-3d113ec85d0e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:43.966814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-37bed63f-8ae4-4309-a89f-3d113ec85d0e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:43.980182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-37bed63f-8ae4-4309-a89f-3d113ec85d0e tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1213 microversion: 2.1 time: 0.120672 Sep 07 13:18:43.982302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 153/307] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:43 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:44.077007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:44.089089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1c4489f0-1ddf-446e-ae1d-fc750d3d1ab0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.358962 Sep 07 13:18:44.101002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 155/308] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:43 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:45.005781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:45.007554 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:45.016605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:45.017877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:45.018553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:45.019482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:45.020746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:45.021390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:45.115636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:45.116795 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:45.119429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:45.127686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4d5d0450-9b9d-44c9-a53c-20c6fcb10fb4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1265 microversion: 2.1 time: 0.126226 Sep 07 13:18:45.128773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:45.129846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:45.130289 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:45.131174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:45.131756 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 154/309] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:44 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:45.132090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:45.133843 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:45.336078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:45.348108 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cbbb1d29-1e1d-4757-b234-6b4e640cbc30 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.237574 Sep 07 13:18:45.348737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 156/310] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:45 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:46.158309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:46.158852 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:46.177992 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.178738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.180266 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.187200 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.190922 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.193045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.345525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:46.374434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:46.375145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:46.380626 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-25125436-5659-4a90-8c6e-8d6ea3550125 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1265 microversion: 2.1 time: 0.227395 Sep 07 13:18:46.400608 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.402312 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 155/311] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:46 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:46.404897 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.407372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.408253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.409958 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.411027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.792359 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:46.821315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-813f3d37-2d40-45da-b5ce-bd55e9189878 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.444328 Sep 07 13:18:46.835142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 157/312] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:46 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:47.412963 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:47.414286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:47.421177 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:47.421978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:47.422634 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:47.423562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:47.424194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:47.424798 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:47.527445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:47.537063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8865a398-ec5e-4d65-84e8-7281d8b1b70f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1271 microversion: 2.1 time: 0.127578 Sep 07 13:18:47.537677 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 156/313] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:47 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:47.849413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:47.850013 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:47.856919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:47.857399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:47.858043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:47.858798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:47.859215 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:47.859640 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:48.122141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:48.131362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-94925865-8554-4176-92f6-44da4d57d057 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.286341 Sep 07 13:18:48.132329 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 158/314] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:47 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:48.470148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1309979179", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "networks": [{"uuid": "36f97f4f-1c7e-49fe-8c6d-4824f74f7dae"}]}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:48.545072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] validate_networks() for [('36f97f4f-1c7e-49fe-8c6d-4824f74f7dae', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:18:48.564241 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:48.565356 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:48.574018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:48.574870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:48.575343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:48.576162 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:48.576625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:48.577057 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:48.909073 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:48.919907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d039df18-e684-4d9d-a48e-d5700486bb56 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.360658 Sep 07 13:18:48.920495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 159/315] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:48 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:49.085256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-4c269cc3-da44-4d12-983d-b8c68241f913 req-7d9e2a59-f9c7-4a8f-8261-cc9ea7885966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee", "tag": "655967da-ac92-4ce7-8269-545e687bc611"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:49.096084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-4c269cc3-da44-4d12-983d-b8c68241f913 req-7d9e2a59-f9c7-4a8f-8261-cc9ea7885966 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.096930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-4c269cc3-da44-4d12-983d-b8c68241f913 req-7d9e2a59-f9c7-4a8f-8261-cc9ea7885966 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.097769 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-4c269cc3-da44-4d12-983d-b8c68241f913 req-7d9e2a59-f9c7-4a8f-8261-cc9ea7885966 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.111380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-4c269cc3-da44-4d12-983d-b8c68241f913 req-7d9e2a59-f9c7-4a8f-8261-cc9ea7885966 service nova] Creating event network-changed:655967da-ac92-4ce7-8269-545e687bc611 for instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee on hv-cinder-80403 Sep 07 13:18:49.118194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-4c269cc3-da44-4d12-983d-b8c68241f913 req-7d9e2a59-f9c7-4a8f-8261-cc9ea7885966 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037219 Sep 07 13:18:49.119751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 160/316] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:49.164595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:49.165981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:49.176317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.177746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.178578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.180226 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.181384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.182573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.291007 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:18:49.291547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:18:49.292104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:18:49.292649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:18:49.293263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:18:49.305957 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.306616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.307530 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.308485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.309174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.309720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.331708 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Getting quotas for project d916ed5ea0874a0f85089a99d4a66c12. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:18:49.338044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Getting quotas for user d6083ed15f884ffea8550f28addcbfcd and project d916ed5ea0874a0f85089a99d4a66c12. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:18:49.351670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:18:49.354139 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:18:49.411336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4d109b69-e997-4314-9d88-b97f0bc0ea7d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940312 Sep 07 13:18:49.411336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 157/317] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:18:49.417829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4ba888a6-83d5-4595-a8b1-88e2abb35165 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:49.418453 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4ba888a6-83d5-4595-a8b1-88e2abb35165 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:49.498373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4ba888a6-83d5-4595-a8b1-88e2abb35165 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:49.501908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:49.511886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4ba888a6-83d5-4595-a8b1-88e2abb35165 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1219 microversion: 2.1 time: 0.098041 Sep 07 13:18:49.512496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 158/318] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:49 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:49.515819 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7172b39d-0a16-43dd-93f0-53be26aa9d62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.364209 Sep 07 13:18:49.517010 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 161/319] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:49 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:49.943740 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:49.945158 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:49.955733 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.956268 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.957577 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.958032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.958493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.958925 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.271124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:50.286085 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d4802cea-133d-4301-86af-fd66c4cd4e6c tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.346600 Sep 07 13:18:50.287051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 159/320] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:49 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:50.537428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:50.538044 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:50.546867 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:50.548028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:50.581383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.581990 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.582591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.583349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.583806 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.584235 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.591218 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.591721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.592158 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.594071 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.594553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.594974 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.722347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:50.731538 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7128c6e8-e07f-458e-a68b-8cb88e672352 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1271 microversion: 2.1 time: 0.198497 Sep 07 13:18:50.732133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 162/321] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:50 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:50.807201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:50.816025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-68ff6005-634b-421d-b67a-8d521b405062 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.273755 Sep 07 13:18:50.816766 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 160/322] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:50 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:51.313638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.314249 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:51.321125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.321612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.322051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.322757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.323252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.323682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.460369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:51.468556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-992804cd-8ab5-46fe-b48e-f61d398e5440 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.158865 Sep 07 13:18:51.469197 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 163/323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:51.757225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.757908 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:51.765402 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.765901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.766340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.767045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.767552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.767981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.834545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:51.840782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.841398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:51.845279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8058b559-9279-4288-bcdb-bcc0f2017393 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1271 microversion: 2.1 time: 0.093076 Sep 07 13:18:51.845863 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 161/324] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:51.848202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.848696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.849294 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.849846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.850304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.850728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.870671 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:52.002365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:52.013508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5176445d-9018-48c0-881e-9934f537d130 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.176555 Sep 07 13:18:52.015951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 164/325] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:52.496053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:52.496907 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:52.499586 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:52.509099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:52.509737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:52.510290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:52.511306 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:52.512110 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:52.512504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:52.664782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:52.673369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fa5a2f07-6e07-4cd7-90fa-f8eac54f71cb tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.183024 Sep 07 13:18:52.673960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 162/326] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:52 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:52.870264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:52.870947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:52.878106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:52.879136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:52.879585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:52.880299 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:52.880747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:52.881170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:52.948683 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:52.957737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-103af2ec-1b12-4b6e-86d0-2ee1ecea9bdb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1271 microversion: 2.1 time: 0.090846 Sep 07 13:18:52.958334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 165/327] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:52 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:53.038520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:53.039160 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:53.046092 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.046592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.047036 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:53.047782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.048244 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.048672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:53.198808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:53.208067 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7387aeec-f0ec-4735-a273-e0b02adf7b0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.173448 Sep 07 13:18:53.208682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 163/328] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:53 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:53.700539 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:53.712398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:53.722660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.723562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.724632 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:53.725932 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.727300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.728284 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:53.981784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:53.982028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:53.988315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.988814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.989254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:53.990003 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.990460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.990886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.016138 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:54.026261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7ee1845c-9a10-4f52-a8c7-493ebe5e1d8b tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.332946 Sep 07 13:18:54.027096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 166/329] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:53 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:54.066780 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:54.075716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-100a6ace-dd0a-440e-885e-a76dd928c25e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1277 microversion: 2.1 time: 0.098867 Sep 07 13:18:54.077184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 164/330] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:53 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:54.230973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:54.231952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:54.239441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.240247 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.241089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.241995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.242718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.243337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.495373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:54.514344 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6259d8d6-f10a-4d33-9dce-0bd99b41eebf tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.287225 Sep 07 13:18:54.516273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 167/331] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:54 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:55.054991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:55.060514 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:55.075228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.075228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.075228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.075228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.076263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.076263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.107193 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:55.108605 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:55.119043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.120103 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.120764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.122256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.124009 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.125055 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.413643 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:55.422694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:55.430699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1afd1ca9-70c8-447a-9952-6ae34b836be4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.331768 Sep 07 13:18:55.431326 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 168/332] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:55 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:55.436526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e78f98c1-020d-4d7e-b817-c21ad5c69425 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.389482 Sep 07 13:18:55.437283 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 165/333] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:55 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:55.471809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-0de9f12b-1e10-40e9-b482-62e046df1c20 req-fa99c109-f907-4749-bf6d-9e21ba6f8674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c34f79c-8a91-4270-bcfc-43a41295b5c4", "tag": "1f60bf3d-7a70-49f9-932a-af22a4c4e53c"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:55.502264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0de9f12b-1e10-40e9-b482-62e046df1c20 req-fa99c109-f907-4749-bf6d-9e21ba6f8674 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.503245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0de9f12b-1e10-40e9-b482-62e046df1c20 req-fa99c109-f907-4749-bf6d-9e21ba6f8674 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.506639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0de9f12b-1e10-40e9-b482-62e046df1c20 req-fa99c109-f907-4749-bf6d-9e21ba6f8674 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.528625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-0de9f12b-1e10-40e9-b482-62e046df1c20 req-fa99c109-f907-4749-bf6d-9e21ba6f8674 service nova] Creating event network-changed:1f60bf3d-7a70-49f9-932a-af22a4c4e53c for instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 on hv-cinder-80403 Sep 07 13:18:55.538971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-0de9f12b-1e10-40e9-b482-62e046df1c20 req-fa99c109-f907-4749-bf6d-9e21ba6f8674 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070559 Sep 07 13:18:55.540310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 169/334] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:55.540639 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:55.541200 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:55.549544 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.550047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.550541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.551294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.551749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.552173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.820862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:55.829541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-21ecd637-e1c7-44eb-900b-f2caf562f075 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.295212 Sep 07 13:18:55.830122 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 166/335] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:55 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:56.202715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-36bb0974-ed3d-45c9-8965-f5df3720db05 req-40a09451-5d4e-43f0-af8e-aa3b1508155f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee", "name": "network-vif-plugged", "status": "completed", "tag": "655967da-ac92-4ce7-8269-545e687bc611"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:56.213502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-36bb0974-ed3d-45c9-8965-f5df3720db05 req-40a09451-5d4e-43f0-af8e-aa3b1508155f service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.213985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-36bb0974-ed3d-45c9-8965-f5df3720db05 req-40a09451-5d4e-43f0-af8e-aa3b1508155f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.214494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-36bb0974-ed3d-45c9-8965-f5df3720db05 req-40a09451-5d4e-43f0-af8e-aa3b1508155f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.227669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-36bb0974-ed3d-45c9-8965-f5df3720db05 req-40a09451-5d4e-43f0-af8e-aa3b1508155f service nova] Creating event network-vif-plugged:655967da-ac92-4ce7-8269-545e687bc611 for instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee on hv-cinder-80403 Sep 07 13:18:56.233941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-36bb0974-ed3d-45c9-8965-f5df3720db05 req-40a09451-5d4e-43f0-af8e-aa3b1508155f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035242 Sep 07 13:18:56.234859 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 170/336] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:56.454123 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.454810 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.462470 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.462971 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.463472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.464193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.464656 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.465091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.465566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.466299 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.483904 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.484608 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.485059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.486005 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.486472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.486938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:57.048977 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:57.056241 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:57.058690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ed03a693-e211-494d-ba42-da7ef25fa28e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.608495 Sep 07 13:18:57.059418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 167/337] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:57.064306 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-088d29a1-b496-4c89-b636-168b798116ee tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.603406 Sep 07 13:18:57.065218 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 171/338] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:57.067623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:57.068312 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:57.076545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:57.077368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:57.077961 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:57.078845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:57.079982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:57.079982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:57.259164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:57.267057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8764dabf-a7d2-4260-aa6c-a6ba3003da36 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.203836 Sep 07 13:18:57.267677 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 168/339] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:57 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:58.088434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:58.089719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:58.099049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:58.099989 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:58.103003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.103961 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.104997 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:58.106856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.107378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.107529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.108105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:58.108238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.108673 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:58.109278 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.109911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.110503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:58.386382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:58.388833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:58.392529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:58.393563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-595096bb-cf99-4635-a464-6928801a0fba tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.314153 Sep 07 13:18:58.394545 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 172/340] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:58 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:58.399897 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:58.400813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:58.406973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.407856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.407986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:58.408990 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.410147 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.410735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:58.415837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5b4f13cc-2933-4846-b410-b05a4a466208 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.323001 Sep 07 13:18:58.418534 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 169/341] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:58 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:58.665309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:58.676252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f8266992-1890-4d79-9b43-feb796a0907a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.280330 Sep 07 13:18:58.676849 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 173/342] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:58 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:59.422157 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:59.432652 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:59.436029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=4 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:59.444192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.446229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.447208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.448137 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.448764 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.449371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.452361 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:59.453719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:59.481235 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.482479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.483526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.485026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.486431 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.487928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.513074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=16 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:59.659913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:59.672077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2f2f99bf-f0dc-4d4e-8b5e-2ddbf4c438f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.256583 Sep 07 13:18:59.672949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 170/343] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:59 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:59.705225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:59.705839 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:59.713023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.713465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.714213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.714813 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.715525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.716113 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.728487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:59.737247 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-528ae714-57d4-45fb-86f0-3d266c59e429 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.299280 Sep 07 13:18:59.738723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 174/344] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:59 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:59.906201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:59.916021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-45aa61a0-6569-40f6-94fe-3e41d1d805fd tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.217094 Sep 07 13:18:59.916610 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 171/345] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:59 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:00.719891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:00.720682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:00.728010 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.728704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.729147 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:00.729845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.730722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.731342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:00.767141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:00.768405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:00.778340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.778872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.780089 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:00.781109 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.781738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.782319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:01.010053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:01.020761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e3f432f6-e2ac-446b-ab34-cdcd55aaa0dd tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.306208 Sep 07 13:19:01.038854 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 175/346] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:00 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:01.044775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:01.045315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:01.053073 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:01.053847 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:01.054558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:01.055323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:01.055939 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:01.056531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:01.156833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:01.169608 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2584a580-a211-4fbb-a80a-690593e2fd70 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1313 microversion: 2.1 time: 0.410799 Sep 07 13:19:01.170410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 172/347] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:00 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:01.268056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:01.276552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-248d1c39-08f1-4712-bcee-f771b074adbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.236107 Sep 07 13:19:01.277152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 176/348] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:01 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:02.049645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.051044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:02.060482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.060994 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.061601 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.062325 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.063152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.063575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.200937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.203047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:02.216051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.216939 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.217735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.219053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.220242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.221031 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.249676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:02.259597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-10368f99-d820-4186-826f-59a4cfe50245 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.216472 Sep 07 13:19:02.260466 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 173/349] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:02 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:02.307701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.308394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:02.314961 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.315637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.316161 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.316939 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.317485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.317963 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.458328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:02.466687 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1fa5e639-6497-4d03-aa09-5eeb740f1f93 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1495 microversion: 2.1 time: 0.275686 Sep 07 13:19:02.467315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 177/350] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:02 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1495 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:02.512690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:02.526846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-57c7ddfa-5469-421d-b173-c92f7183b313 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.223426 Sep 07 13:19:02.531149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 174/351] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:02 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:02.898374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-86f06a9e-1f8e-4e36-ad69-f3291bc7d8c4 req-d119d2d5-2a50-4e44-931e-d4259372b380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c34f79c-8a91-4270-bcfc-43a41295b5c4", "name": "network-vif-plugged", "status": "completed", "tag": "1f60bf3d-7a70-49f9-932a-af22a4c4e53c"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:02.913341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-86f06a9e-1f8e-4e36-ad69-f3291bc7d8c4 req-d119d2d5-2a50-4e44-931e-d4259372b380 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.914642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-86f06a9e-1f8e-4e36-ad69-f3291bc7d8c4 req-d119d2d5-2a50-4e44-931e-d4259372b380 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.915328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-86f06a9e-1f8e-4e36-ad69-f3291bc7d8c4 req-d119d2d5-2a50-4e44-931e-d4259372b380 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.946302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-86f06a9e-1f8e-4e36-ad69-f3291bc7d8c4 req-d119d2d5-2a50-4e44-931e-d4259372b380 service nova] Creating event network-vif-plugged:1f60bf3d-7a70-49f9-932a-af22a4c4e53c for instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 on hv-cinder-80403 Sep 07 13:19:02.957587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-86f06a9e-1f8e-4e36-ad69-f3291bc7d8c4 req-d119d2d5-2a50-4e44-931e-d4259372b380 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062735 Sep 07 13:19:02.960268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 178/352] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:03.282820 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.283632 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:03.291503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.291693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.292073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.292741 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.293443 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.293976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.435827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:03.443494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-01e946a6-55d0-483e-9b3d-2d9efd9e0b0b tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.164679 Sep 07 13:19:03.444059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 175/353] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:03 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:03.552844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.553580 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:03.559681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.560165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.560603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.561288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.561746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.562170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.698905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:03.707574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9827ad65-58bd-4157-8b0a-e12f1cb68d83 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.158887 Sep 07 13:19:03.708243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 179/354] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:03 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:03.873245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.873737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:03.880706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.881202 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.881637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.882367 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.882818 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.883314 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.919277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:19:04.016180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-33e16b0f-2b3b-45d6-8705-eae5b5f45fa8 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "DELETE /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 204 len: 0 microversion: 2.1 time: 0.146988 Sep 07 13:19:04.017073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 176/355] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:19:03 2022] DELETE /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:19:04.025103 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:04.025962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:04.032027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:04.032735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:04.033239 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:04.034219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:04.034831 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:04.035383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:04.194662 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:04.203452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-69f54d31-31da-4bef-945e-02c66678c740 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1501 microversion: 2.1 time: 0.182040 Sep 07 13:19:04.204037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 180/356] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:04 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:04.468280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:04.468968 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:04.476854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:04.477344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:04.477784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:04.478704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:04.479203 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:04.479626 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:04.637837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:04.649801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2b03d5dc-ce52-429b-b425-23a09f2272f6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.185829 Sep 07 13:19:04.650824 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 177/357] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:04 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:04.731548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:04.732402 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:04.738624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:04.739337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:04.739566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:04.740434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:04.741122 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:04.741667 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:04.935953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:04.945508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-befd0f94-143e-4a8e-84b1-0524910ab15e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.218010 Sep 07 13:19:04.961699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 181/358] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:04 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:05.229895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.231140 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:05.237457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.238255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.238935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.239936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.240610 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.241253 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.396402 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:05.405112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b7561770-e332-46c2-b344-59574dced99f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1501 microversion: 2.1 time: 0.179102 Sep 07 13:19:05.405848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 178/359] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:05 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:05.675425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.676039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:05.683261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.684071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.684817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.686622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.687447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.687890 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.863036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:05.871620 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7a43e67d-8122-4370-a875-8e5371cbb650 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.201304 Sep 07 13:19:05.873119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 182/360] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:05 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:05.970350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.972554 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:05.978846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.979381 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.979823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.980785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.981738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.982489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.159687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:06.168550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c4f3e22a-decb-4ab9-8da6-d9a400074875 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.202137 Sep 07 13:19:06.169418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 179/361] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:05 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:06.435924 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.436732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:06.446115 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.446917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.447755 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.448698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.449354 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.449994 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.456704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:06.621573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:06.629720 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7107f3a3-c1c9-44f6-9cc7-d86de4b04ef3 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1501 microversion: 2.1 time: 0.197975 Sep 07 13:19:06.630509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 183/362] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:06 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:06.895312 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.896327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:06.905475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.906203 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.907074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.908044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.908755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.909250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:07.141449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:07.150071 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4b350b96-8b79-4e43-b018-bb8c3634e649 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.259405 Sep 07 13:19:07.150640 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 180/363] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:06 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:07.193983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:07.195447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:07.198153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=74 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:07.204077 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:07.204568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:07.205237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:07.205978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:07.206449 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:07.207135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:07.473546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:07.488814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f7d7e36c-0f6d-44b3-9a79-48a256b58605 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.300195 Sep 07 13:19:07.489861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 184/364] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:07 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:07.656516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:07.657654 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:07.664897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:07.665660 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:07.666302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:07.667063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:07.667721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:07.668151 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:07.853583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:07.872467 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1e1fa0aa-a0c3-49f2-8dc4-6bbe41c9dde2 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1501 microversion: 2.1 time: 0.219996 Sep 07 13:19:07.883175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 181/365] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:07 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:08.176083 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:08.176695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:08.182971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.183501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.183940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.184644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.185099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.185527 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.331989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:08.342586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5d96f461-001a-4e3b-b59d-64b53eac87f4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.170157 Sep 07 13:19:08.343389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 185/366] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:08 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:08.524620 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:08.525680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:08.532760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.534280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.534280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.535976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.536518 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.537021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.765299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:08.776862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-da682a75-10c9-4688-bb0e-c3d9156dd71d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1521 microversion: 2.1 time: 0.256004 Sep 07 13:19:08.778065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 182/367] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:08 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:08.897019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:08.898144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:08.905648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.906547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.907258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.908336 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.909681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.910308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:09.065700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:09.083456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-958a9b2c-afbd-4846-b3ef-888236d27c90 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1501 microversion: 2.1 time: 0.190848 Sep 07 13:19:09.084695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 186/368] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:08 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:09.365845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:09.366800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:09.373381 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:09.374152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:09.374828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:09.375572 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:09.376026 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:09.376611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:09.545242 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:09.560630 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-89a061d6-8153-4e3f-94f7-b263e79e5962 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.198470 Sep 07 13:19:09.561595 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 183/369] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:09 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:09.803276 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:09.804568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:09.811407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:09.812005 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:09.812556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:09.813514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:09.814175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:09.815371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.029238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:10.040375 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8162a3b2-5467-4bfd-be68-9f7c1b24169b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1501 microversion: 2.1 time: 0.241035 Sep 07 13:19:10.056429 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 187/370] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:09 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:10.077109 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:10.077879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:10.085125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:10.086789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:10.087543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.088420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:10.089093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:10.089669 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.110370 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:10.110985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:10.131677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:10.131677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:10.131677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.131677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:10.131987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:10.131987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.251459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:10.264051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-aaf94ac8-efed-4862-94fa-477341e7433a tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1459 microversion: 2.1 time: 0.159729 Sep 07 13:19:10.277243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 188/371] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:10 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1459 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:10.285035 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-141789f5-3034-45fa-a75f-627b855987c9 req-2c40517e-3d9f-4800-8a13-8644e278b0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee", "name": "network-vif-deleted", "tag": "655967da-ac92-4ce7-8269-545e687bc611"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:10.298111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-141789f5-3034-45fa-a75f-627b855987c9 req-2c40517e-3d9f-4800-8a13-8644e278b0c7 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:10.298709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-141789f5-3034-45fa-a75f-627b855987c9 req-2c40517e-3d9f-4800-8a13-8644e278b0c7 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:10.300158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-141789f5-3034-45fa-a75f-627b855987c9 req-2c40517e-3d9f-4800-8a13-8644e278b0c7 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.314419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-141789f5-3034-45fa-a75f-627b855987c9 req-2c40517e-3d9f-4800-8a13-8644e278b0c7 service nova] Creating event network-vif-deleted:655967da-ac92-4ce7-8269-545e687bc611 for instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee on hv-cinder-80403 Sep 07 13:19:10.320491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-141789f5-3034-45fa-a75f-627b855987c9 req-2c40517e-3d9f-4800-8a13-8644e278b0c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041082 Sep 07 13:19:10.321106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 189/372] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:10.378371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:10.382180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:10.388860 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-22d82a76-818b-4d4d-9e4f-536f54d9f8c4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1516 microversion: 2.1 time: 0.326766 Sep 07 13:19:10.389554 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 184/373] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:10 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1516 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:10.590622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:10.592113 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:10.603291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:10.604480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:10.605876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.606721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:10.607569 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:10.608388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.918908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:10.930284 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b181174e-5aee-48d7-8546-f92387c013a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1319 microversion: 2.1 time: 0.348031 Sep 07 13:19:10.941088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 190/374] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:10 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:11.290973 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:11.291938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:11.304605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.305242 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.305741 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.306626 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.307081 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.307708 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.402982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:11.414213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f18077e4-739f-472a-b81b-a8528f2d67d4 tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1298 microversion: 2.1 time: 0.127598 Sep 07 13:19:11.427135 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 185/375] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:11 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:11.828248 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:11.830489 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:11.836972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.837463 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.837937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.838644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.839136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.839557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.867471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lazy-loading 'flavor' on Instance uuid 6e55303d-58ec-44db-a67c-2e9729dc076b {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:19:11.956960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:11.957696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:11.964011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.964586 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.965254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.966109 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.966564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.966990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.994918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c2764f7f-c75b-41f4-b5d7-ac1c9e146f8a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b/action" status: 200 len: 32 microversion: 2.1 time: 0.170423 Sep 07 13:19:11.995560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 191/376] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:19:11 2022] POST /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:19:12.005856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:12.006950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:12.013785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:12.014297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:12.014297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:12.015474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:12.016000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:12.016542 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:12.172276 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:12.183483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0f28dcd3-aff9-45ea-990d-cdfa311af48e tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1507 microversion: 2.1 time: 0.230934 Sep 07 13:19:12.184261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 186/377] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:11 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:12.214482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:12.235325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-77fe32ee-6b40-476a-aedc-38efaf48cf94 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.233315 Sep 07 13:19:12.236295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 192/378] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:12 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:12.452569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:12.454368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:12.467984 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:12.468663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:12.469500 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:12.471694 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:12.472663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:12.473259 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:12.530060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:12.530621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:12.531056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:12.531730 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lazy-loading 'fault' on Instance uuid af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:19:12.624823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:12.636548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9e34b09c-0c0f-4d10-b0eb-682d6892247f tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1303 microversion: 2.1 time: 0.199103 Sep 07 13:19:12.637296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 187/379] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:12 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:13.279573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:13.280731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:13.287168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.287732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.288100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.288799 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.289247 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.289667 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.421353 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:13.429512 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-24c119ea-7d39-43b8-b46b-23f2ed85b96d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.153827 Sep 07 13:19:13.430086 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 193/380] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:13 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:13.526375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:13.526918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:13.534860 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.535746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.536459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.537501 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.537978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.538563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.567374 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-385360ec-f5ae-47d0-bad3-dd101fb69686 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/ips" status: 200 len: 151 microversion: 2.20 time: 0.044819 Sep 07 13:19:13.567915 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 188/381] 10.222.0.61 () {60 vars in 1289 bytes} [Wed Sep 7 13:19:13 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:19:13.673299 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:13.674341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:13.680650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.681135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.681569 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.683174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.683444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.683881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.718461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.719633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.720229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.720834 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lazy-loading 'fault' on Instance uuid af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:19:13.834531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93418e3e264a1f8597f789ee888b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3b344911654d3a83328d54b8feca0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:13.852015 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-11576b47-b6a3-48f4-8262-e302340186dd tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 200 len: 1303 microversion: 2.1 time: 0.182387 Sep 07 13:19:13.867140 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 194/382] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:13 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 1303 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:14.451672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:14.452340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:14.458291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.458773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.459237 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.460159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.460777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.461198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.592518 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:14.600313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-862a56fa-0633-4154-a157-2fedefb00647 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.152451 Sep 07 13:19:14.600881 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 189/383] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:14 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:14.881061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:14.881673 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] [instance: af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:14.888536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.888536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.888770 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.889449 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.889946 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.890372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.903943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] HTTP exception thrown: Instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee could not be found. Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Request method failure captured: Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee HTTP/1.1 Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJoC7zr_EuCbGtrbNV70ItTsKUqFZKFulMxLowrs2qK2wgRaZiLqVN5toGJ3wzHRUOqQu_G4hB4OYSDsYQbXGzHBh_cF2xe4EPICXGoqVRv5NqY44t0h4ZfZ8pkVnCLDmopZO5IL5fO53gI8Vr7sHM-d5ose8MgEiTkLd_11AHlBCk8 Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 6d3b344911654d3a83328d54b8feca0e Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesActionsTest-1793814920 Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:19:14.905576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d3b344911654d3a83328d54b8feca0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d3b344911654d3a83328d54b8feca0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d3b344911654d3a83328d54b8feca0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d3b344911654d3a83328d54b8feca0e"}]}] Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesActionsTest-1793814920 Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 6d3b344911654d3a83328d54b8feca0e Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesActionsTest-1793814920 Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesActionsTest-1793814920-project Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 3f93418e3e264a1f8597f789ee888b4e Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesActionsTest-1793814920-project Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee could not be found. Sep 07 13:19:14.907137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee'} Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee could not be found. Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:14.908110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee could not be found. Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee could not be found. Sep 07 13:19:14.910220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:19:14.911555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] Returning 404 to user: Instance af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:14.911555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cf97bb79-89ed-463e-b6e9-9104826892de tempest-VolumesActionsTest-1793814920 tempest-VolumesActionsTest-1793814920-project] 10.222.0.61 "GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee" status: 404 len: 111 microversion: 2.1 time: 0.029639 Sep 07 13:19:14.911555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 195/384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:14 2022] GET /compute/v2.1/servers/af9096d8-7c39-4bd2-bb0a-54ebfa41a5ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:15.623171 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:15.623861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:15.630900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:15.631444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:15.631944 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:15.632714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:15.633231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:15.633739 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:15.784624 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:15.793539 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e5d53b3b-cec6-44ce-a192-d3d0dc85cd71 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.174236 Sep 07 13:19:15.794098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 190/385] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:15 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:16.819235 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:16.820121 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:16.829493 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:16.830049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:16.830488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:16.831784 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:16.836899 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:16.837644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:16.981258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:16.990654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4ea553a5-dfc8-49df-99c0-cec62bc91682 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.178284 Sep 07 13:19:16.991345 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 196/386] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:16 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:18.014286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:18.014981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:18.021929 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.022567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.023225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.024512 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.025063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.025511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.165901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:18.174767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c5ead3f2-bc62-44fc-aa1e-229d2484d52c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.164785 Sep 07 13:19:18.175371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 191/387] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:18 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:19.197997 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:19.198589 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:19.204655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.205143 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.205587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.206287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.206742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.207320 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.339282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.349630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e47be3d2-b2af-487e-b1fe-823546f5dac0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.155685 Sep 07 13:19:19.363437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 197/388] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:19 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:19.373844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:19.374441 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:19.381126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.381682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.382042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.382735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.383212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.383638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.408334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lazy-loading 'flavor' on Instance uuid aa967676-e023-44fe-af50-47db2225c4c5 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:19:19.605129 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e37d375c-833d-4803-949c-f12e784ef17c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/action" status: 202 len: 0 microversion: 2.20 time: 0.233764 Sep 07 13:19:19.605767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 192/389] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Sep 7 13:19:19 2022] POST /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:19:19.614846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:19.615470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:19.621501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.621978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.622597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.623316 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.623764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.624188 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.819158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.824830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:19.830716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.832708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.833864 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-751ca06c-b4f1-4f32-9d50-86055125696d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.223640 Sep 07 13:19:19.834409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 198/390] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:19 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:20.375670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:20.377141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:20.387439 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.388046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.388779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.389743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.390463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.391754 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.534720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:20.544827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7a5d2e95-3913-4173-90f3-b0eaa05d0143 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.173958 Sep 07 13:19:20.545412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 193/391] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:20 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:20.861402 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:20.862018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:20.876539 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.877115 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.880588 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.881445 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.881971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.883528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:21.065360 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:21.092588 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:21.094430 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:21.095697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6af5c901-a99c-4685-8e97-7b0f7a72f565 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.238376 Sep 07 13:19:21.098129 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 199/392] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:20 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:21.569460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:21.570257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:21.576906 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:21.577401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:21.577985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:21.578823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:21.579295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:21.580502 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:21.721642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:21.731096 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-67fde1da-4b85-440e-b5ff-1408b636fec3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.166275 Sep 07 13:19:21.731698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 194/393] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:21 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:22.129646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:22.130282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:22.138722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.139662 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.140153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.141529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.142124 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.142624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.314892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.326220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.327770 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.329080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-711242d6-5137-4290-9a93-41d5ff2c6377 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.205832 Sep 07 13:19:22.330119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 200/394] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:22 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:22.754547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:22.755483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:22.758119 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:22.763952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.764449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.764900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.765772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.766226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.766647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.920598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.929222 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0492a450-3533-4b82-87cf-3407021c0559 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.178713 Sep 07 13:19:22.930106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 195/395] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:22 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:23.354155 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:23.355695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:23.389931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.390642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.393708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.396875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.397361 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.401536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.617581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.629913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.633043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.634314 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3fca4211-1815-4443-ac54-1ead45bded96 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.284168 Sep 07 13:19:23.648874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 201/396] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:23 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:23.954880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:23.956094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:23.970098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.973827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.974402 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.975647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.977557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.978605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.278896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:24.294030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0338ee3d-3084-4a34-89cd-4038023ad031 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.343304 Sep 07 13:19:24.295169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 196/397] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:23 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:24.662444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:24.663700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:24.672023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.672862 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.673940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.676276 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.677115 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.677788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.933396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:24.944215 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:24.945532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:24.946740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d22efc2a-a249-4096-85d6-4837b6be5c91 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.288672 Sep 07 13:19:24.947558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 202/398] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:24 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:25.094631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:25.096197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:25.109133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.109856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:25.117971 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.118995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.119600 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:25.120131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.180417 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d1fa799a-e826-4e11-9a8b-11ee7663a2e4 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/ips" status: 200 len: 144 microversion: 2.1 time: 0.093348 Sep 07 13:19:25.193881 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 197/399] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:19:25 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/ips => generated 144 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:25.344957 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:25.346637 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:25.366572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.367068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:25.367766 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.370120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.370951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:25.371646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.715032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:25.725369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6a394ebf-17b9-464a-9adb-b0288cac05ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.409802 Sep 07 13:19:25.726291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 203/400] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:25 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:25.977542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:25.982888 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:25.993721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.994387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:25.995012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.995984 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.996545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.001133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:26.220627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.238442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.240005 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.246496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e139c0c1-7388-48eb-8987-586d26fd214f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.275503 Sep 07 13:19:26.248430 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 198/401] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:25 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:26.750211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:26.750824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:26.760618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.761111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.761547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:26.766836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.767584 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.768757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.080132 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.096889 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b0ba4c7e-20a3-4813-9616-fea91d844018 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.350820 Sep 07 13:19:27.100053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 204/402] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:26 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:27.274068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:27.274914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:27.286393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.286912 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.287439 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.288271 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.288734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.289162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.521426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.527657 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:27.530450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.538800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.540065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e5a24e8d-d3bd-4df3-a0a9-378012833c5b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.270093 Sep 07 13:19:27.540630 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 199/403] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:27 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:28.125868 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:28.127976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:28.137342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.138270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.140232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.142415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.143558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.144165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.401579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:28.412355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d0f8bc4a-e010-424a-b0df-dbd42a34b6a8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.291117 Sep 07 13:19:28.413414 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 205/404] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:28 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:28.574145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:28.575436 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:28.588491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.593559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.595646 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.597047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.604010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.606333 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.132062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.146094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.149753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.155702 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-036cb68c-a041-408e-acad-332351396178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.587781 Sep 07 13:19:29.180668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 200/405] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:28 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:29.441072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:29.442495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:29.448823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.455137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.456205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.456948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.457406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.457831 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.823696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.833192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-93837850-55dd-4370-b4c7-3e54bb77a7fe tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.395911 Sep 07 13:19:29.856581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 206/406] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:29 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:30.200533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:30.201304 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:30.214408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.218384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.218986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.219932 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.220519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.221718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.587222 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.608228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.610491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.614751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-64ec11b7-10bc-4d75-8683-dd37a7b6dab0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.422036 Sep 07 13:19:30.615623 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 201/407] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:30 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:30.873251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:30.875509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:30.905678 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.907205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.907986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.913260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.916289 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.916890 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.578555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.587692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-85c08fab-51c6-4cbc-8e5a-c7c782ca3703 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.727379 Sep 07 13:19:31.588926 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 207/408] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:30 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:31.645802 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:31.646586 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:31.654773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.655670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.656744 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.657571 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.658286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.659967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.879151 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.899356 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.903043 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.907805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2749912b-7d4a-4c27-9160-952c3285cb4b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.267420 Sep 07 13:19:31.926658 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 202/409] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:31 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:32.249612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eab453e4-dac8-4f03-852a-ad17dac9f4bb"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:32.257503 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:32.265800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.268085 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.268813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.270384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.272075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.272835 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.618506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:32.623363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:32.659543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.671550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.673449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.680302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.681736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.685404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.000786 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c7d1d197-3d90-4377-8206-4a720e73fa20 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758298 Sep 07 13:19:33.002186 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 208/410] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:19:32 2022] POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:33.010543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.019093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-33ea8c9e-a3f7-4a78-be3c-14eff969bb54 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.410604 Sep 07 13:19:33.023654 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 203/411] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:32 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:33.072477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:33.077613 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:33.113012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.113560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.116739 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.117634 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.120790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.125886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.567525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a8e0ec59-eb4f-4100-a0da-e590ef38b9d1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Action: 'create', calling method: .version_select at 0x7fa3db7c9310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-524724481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM4yJzCCZD/HvhFVXXd37cECWEX1azIJAQKkHzdnwp8XLYwwtvc3mheFPvRw1cZpke+0SECmw4ToU+ddVBMRRUvLrnOL8ELqYKsNyYvmABA3KdddG2H9w67PsAPVvVXEQ=="}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:33.595351 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.610025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.613622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.614244 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-a8e0ec59-eb4f-4100-a0da-e590ef38b9d1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:19:33.615470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-899981e6-616f-4f3e-9ee6-355e4fc8988f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.611744 Sep 07 13:19:33.617577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 209/412] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:33 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:33.625560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-a8e0ec59-eb4f-4100-a0da-e590ef38b9d1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for user 57896ea1ff2046d282fe47e2a8191676 and project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:19:33.646738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a8e0ec59-eb4f-4100-a0da-e590ef38b9d1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [0ff8944f-38ab-43f0-ab4e-20e71fe20c5b] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:19:34.047903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:34.048503 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:34.055230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.055719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.056152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.056846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.057293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.057715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.231741 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:34.245472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9a68cd18-5b45-4e01-817d-d161f4b3ecb7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.201177 Sep 07 13:19:34.246598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 210/413] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:34 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:34.657854 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:34.658613 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:34.666742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.669324 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.670152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.671220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.671854 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.672460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.678042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO oslo.messaging._drivers.impl_rabbit [None req-a8e0ec59-eb4f-4100-a0da-e590ef38b9d1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [0ff8944f-38ab-43f0-ab4e-20e71fe20c5b] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 57868. Sep 07 13:19:34.730889 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a8e0ec59-eb4f-4100-a0da-e590ef38b9d1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.705566 Sep 07 13:19:34.743169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 204/414] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:19:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:35.011518 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.024704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.029813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.033777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-39beacf1-b57e-4081-bd2e-550c565d0e1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.382607 Sep 07 13:19:35.035337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 211/415] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:34 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:35.273023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:35.274187 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:35.287808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:35.288708 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:35.291321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:35.292315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:35.294536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:35.295546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:35.603321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.630667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a65945bb-fbdf-4d85-868b-cca78e86286c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.361478 Sep 07 13:19:35.631334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 205/416] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:35 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:36.063409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:36.064723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:36.074781 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.075927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.077308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.082534 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.083256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.084983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.328007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.341494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.343321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.345041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e6cd55f0-1664-4ae9-ad6f-e9a63ce4bbe8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.286108 Sep 07 13:19:36.352692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 212/417] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:36 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:36.655541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:36.656789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:36.664839 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.665684 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.666367 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.667401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.668400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.669100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.876175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.891269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-87765184-d1ad-4d44-9a5c-4cabb04c6621 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.241031 Sep 07 13:19:36.893132 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 206/418] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:36 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:37.371723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:37.372928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:37.375742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=60 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:37.386780 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.389915 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.390551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.391560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.393843 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.394448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.659082 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:37.689720 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:37.693455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:37.696802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e31ee44f-59b9-4d0a-bd55-dc09c4f4a8d5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.329401 Sep 07 13:19:37.699139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 213/419] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:37 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:37.921807 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:37.922408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:37.942641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.943922 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.944693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.945625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.946321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.946811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.188901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:38.211610 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3ed54502-4a37-4859-9022-481b7e466348 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.293314 Sep 07 13:19:38.212559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 207/420] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:37 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:38.729677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:38.731052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:38.740938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.741910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.742353 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.743149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.743654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.744291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.779201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:38.971149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:38.993444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:38.998277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:38.999929 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5e92662b-46bf-46fe-a145-db1d9d4a01ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.277205 Sep 07 13:19:39.001024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 214/421] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:38 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:39.235510 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:39.237536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:39.245489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:39.245989 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:39.246819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:39.247666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:39.248691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:39.249878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:39.462045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:39.477481 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2bd11c8d-4a94-4193-b275-49e5e27482d5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.245354 Sep 07 13:19:39.491155 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 208/422] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:39 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:40.028549 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:40.029294 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:40.040011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.041157 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.041872 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.043091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.043727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.044371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.238223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.247369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.248827 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.250024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ca20c82e-0c72-42b9-9556-e7be58b5bc81 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.226847 Sep 07 13:19:40.250592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 215/423] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:40 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:40.509888 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:40.510552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:40.516760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.517841 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.518279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.518987 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.519473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.519898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.681671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.694073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-912e6abc-325c-467d-800b-4d98f2db444e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.189130 Sep 07 13:19:40.694672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 209/424] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:40 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:41.276790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:41.277428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:41.289851 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.290345 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.292022 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.292904 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.293397 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.293888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.474891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.484449 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.486467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.488067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a7736d92-5802-44b8-825e-d8ddc2aeaa46 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.215354 Sep 07 13:19:41.488683 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 216/425] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:41 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:41.737603 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:41.738217 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:41.774371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.776900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.795350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.796548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.797310 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.797700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.029106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.045122 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2631aff7-0361-4c1d-8286-29754f58914c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.329198 Sep 07 13:19:42.059528 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 210/426] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:41 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:42.516175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:42.518221 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:42.525468 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.525951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.526386 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.527348 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.527790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.528227 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.698754 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.717549 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.717549 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.718584 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c7782449-d8e7-471b-b1a2-bbe2379dbb14 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1744 microversion: 2.20 time: 0.206765 Sep 07 13:19:42.731647 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 217/427] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:42 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:43.073129 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:43.074498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:43.090633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.091158 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.091599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.092472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.093091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.093683 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.103133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2b99f1ac-962e-47e0-aa6d-fb1807699d81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:43.110160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2b99f1ac-962e-47e0-aa6d-fb1807699d81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.111457 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2b99f1ac-962e-47e0-aa6d-fb1807699d81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.112090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2b99f1ac-962e-47e0-aa6d-fb1807699d81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.179934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2b99f1ac-962e-47e0-aa6d-fb1807699d81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Going to try to stop instance {{(pid=121069) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:19:43.236500 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2b99f1ac-962e-47e0-aa6d-fb1807699d81 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.136670 Sep 07 13:19:43.237715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 218/428] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:19:43 2022] POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:19:43.250412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.257931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:43.259038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:43.261345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9a933594-1868-48aa-9626-dd7061b25586 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.192169 Sep 07 13:19:43.267330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.267835 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.268272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.269195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.269655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.270089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.276409 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 211/429] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:43 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:43.431724 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.441991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1cc08d2a-985f-42e3-a63b-aebd5c6eff18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.189222 Sep 07 13:19:43.442575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 219/430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:43 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:43.742825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=4 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:43.746977 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:43.747619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:43.754401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.754896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.755360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.756066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.756614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.756949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.910149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.923960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.925372 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.926734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7ddc06a4-b086-4b74-9fb0-631185b1ed06 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1744 microversion: 2.20 time: 0.184672 Sep 07 13:19:43.927400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 212/431] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:43 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:44.286186 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:44.286855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:44.293464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.293959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.294411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.295205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.295604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.296038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.466867 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:44.467692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:44.476322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.477219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.478117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.479094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.479573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.480051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.481310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:44.491413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7ea276d0-933d-44d2-ae9f-fbfcb342744c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.209057 Sep 07 13:19:44.507138 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 220/432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:44 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:44.641813 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:44.651230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-34092d9a-80a3-4a93-85a7-757b46392afb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.189404 Sep 07 13:19:44.651817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 213/433] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:44 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:44.953022 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:44.953638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:44.960023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.960508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.960940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.961644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.962104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.962661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.198698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.213302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.215398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.216989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-362318ec-c1fa-400c-b102-7e3aaf7ca60b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1744 microversion: 2.20 time: 0.268227 Sep 07 13:19:45.227216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 221/434] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:44 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1744 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:45.515960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:45.516580 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:45.524384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.525109 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.525706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.526566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.527204 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.527813 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.676271 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:45.677632 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:45.678066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.689543 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.689801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-826b7af8-aa9f-42b0-879e-de33ac78353b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.177300 Sep 07 13:19:45.690660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.690845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 214/435] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:45 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:45.691505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.692572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.693209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.693801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.850618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.862022 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6f6a0041-fb1f-4909-80bf-ad289678dea7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.190133 Sep 07 13:19:45.862791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 222/436] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:45 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:46.265721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:46.267644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:46.278679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.279729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.280624 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.281892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.282801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.284140 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.491181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.501631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.503660 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.506007 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-244649b3-7290-474d-b6f1-d3a4ce7ca4d4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.248134 Sep 07 13:19:46.506706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 215/437] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:46 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:46.721848 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:46.722450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:46.735097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.736365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.736815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.737532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.737992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.738425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.888792 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:46.889578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:46.897019 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.897854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.898292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.899303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.899580 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.900001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.902850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.915809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ea6ece4b-607b-4ee2-a606-5a55e096e732 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.197513 Sep 07 13:19:46.932855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 223/438] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:46 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:47.082714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:47.092896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8814333e-5d02-422e-809f-5244bca5f761 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.207636 Sep 07 13:19:47.110959 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 216/439] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:46 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:47.188797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-7ed06a17-3a10-46fd-b1d7-02e83ccabaea req-fede4488-6cdb-4045-87c4-534d71e2760f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa967676-e023-44fe-af50-47db2225c4c5", "name": "network-vif-plugged", "status": "completed", "tag": "d09ff3be-283a-4f61-92b6-2a7fe58192db"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:47.203432 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7ed06a17-3a10-46fd-b1d7-02e83ccabaea req-fede4488-6cdb-4045-87c4-534d71e2760f service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.203915 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7ed06a17-3a10-46fd-b1d7-02e83ccabaea req-fede4488-6cdb-4045-87c4-534d71e2760f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.204395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7ed06a17-3a10-46fd-b1d7-02e83ccabaea req-fede4488-6cdb-4045-87c4-534d71e2760f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:47.216288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-7ed06a17-3a10-46fd-b1d7-02e83ccabaea req-fede4488-6cdb-4045-87c4-534d71e2760f service nova] Creating event network-vif-plugged:d09ff3be-283a-4f61-92b6-2a7fe58192db for instance aa967676-e023-44fe-af50-47db2225c4c5 on hv-cinder-80403 Sep 07 13:19:47.222111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-7ed06a17-3a10-46fd-b1d7-02e83ccabaea req-fede4488-6cdb-4045-87c4-534d71e2760f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039857 Sep 07 13:19:47.223238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 224/440] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:47.535688 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:47.536202 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:47.542290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.542769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.543240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:47.543935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.544388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.544814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:47.568167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:47.707506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:47.716628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:47.718271 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:47.720235 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-96bd03f6-86cd-4e8c-b1e5-8962409ba0da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.188421 Sep 07 13:19:47.735372 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 217/441] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:47 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:47.945911 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:47.947716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:47.956104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.957068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.957977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:47.959255 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.960037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.960785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.118284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:48.119565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:48.127279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:48.128159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:48.128599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.129562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:48.130034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:48.130459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.155652 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:48.168066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b2ef712c-8062-42e5-b8b7-34fb357cc696 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.227648 Sep 07 13:19:48.168691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 225/442] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:47 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:48.283141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:48.295206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5280bb8d-3baf-4646-8078-80e00ece80c3 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.181010 Sep 07 13:19:48.295938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 218/443] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:48 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:48.748123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:48.748793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:48.757837 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:48.758322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:48.759685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.760610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:48.761987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:48.764136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.018871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.038032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.041589 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.043391 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-98a388e2-0255-4e62-b6ef-ffdc6f209e37 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.300401 Sep 07 13:19:49.055212 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 226/444] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:48 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:49.199853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:49.200442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:49.217964 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.218818 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.219280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.220749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.221209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.221645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.319337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:49.319943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:49.326824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.327353 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.327771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.328496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.329009 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.330107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.390251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.407403 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-17426091-2a8e-4c3e-972d-b13221a7ddae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.216818 Sep 07 13:19:49.420090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 219/445] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:49 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:49.505021 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.513660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-396ba6d6-bc5b-4aef-a9fe-1afde9f6444c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.198271 Sep 07 13:19:49.514244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 227/446] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:49 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:50.081180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:50.087853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:50.094159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.095437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.096066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.096927 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.097583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.098299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.269270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.278823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.292752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.294529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-59b96817-311a-4691-adeb-041f7a8d12ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.217227 Sep 07 13:19:50.295930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 220/447] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:50 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:50.434191 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:50.434789 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:50.443261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.444095 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.444844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.445966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.446575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.447364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.552229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:50.554816 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:50.565858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.566496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.568691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.569891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.571390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.572461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.824035 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.833609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1de32e4c-21c9-465d-955a-8d04fdae8bae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.403944 Sep 07 13:19:50.842783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 228/448] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:50 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:50.846732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.856346 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9faf2f92-8921-4e59-bc28-f32b136f95c7 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.312284 Sep 07 13:19:50.856913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 221/449] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:50 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:51.321195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:51.321822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:51.327933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.328352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.329298 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.330003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.330464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.330888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.475967 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:51.484937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:51.486411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:51.487633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-453843a5-e121-4e2e-838f-ff8800f089df tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.170521 Sep 07 13:19:51.488476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 229/450] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:51 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:51.857552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:51.858104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:51.865557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.866055 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.866496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.867236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.867697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.868125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.880801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:51.881409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:51.888133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.888664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.889136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.889856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.890490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.891081 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.912615 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:52.139548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:52.151563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:52.153393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-75e8555f-071d-41e8-a757-945480598172 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.300100 Sep 07 13:19:52.153993 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 222/451] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:51 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:52.163183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5ac55644-24a5-47a3-843c-cb8133a07270 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.286124 Sep 07 13:19:52.164257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 230/452] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:51 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:52.518904 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:52.519814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:52.527250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:52.528084 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:52.528749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:52.530565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:52.530565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:52.530565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.186379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:53.187697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:53.201704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.202621 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.203338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.205617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.208483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.212246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.292134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.326940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.334293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.336373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-926d32fd-769b-4cee-877a-4b5331c2475f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.825456 Sep 07 13:19:53.342440 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 223/453] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:52 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:53.348473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:53.349373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:53.361896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:53.365145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.366472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.370463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.371674 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.381519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.383207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.811261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.824927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-09925213-f1dc-48ba-9fed-a7730f245d66 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.642613 Sep 07 13:19:53.825830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 231/454] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:53 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:53.951809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.970934 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-76529a30-9cea-4ac6-b854-681cb493f88a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.626479 Sep 07 13:19:53.973827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 224/455] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:53 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:54.371026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:54.372545 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:54.386656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:54.387567 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:54.389692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:54.401182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:54.402017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:54.403016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:54.624795 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:54.644638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:54.649514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:54.651007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fe7532d9-943d-423c-9514-7dab5d296540 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.284732 Sep 07 13:19:54.651960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 232/456] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:54 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:54.860741 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:54.861909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:54.896725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:54.898219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:54.898964 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:54.900183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:54.901184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:54.902526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.015064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:55.016910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:55.029307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.030012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.030626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.031588 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.037546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.038657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.270239 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:55.280317 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-929870b0-cf4f-4d0b-9b27-582aaecf744d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1502 microversion: 2.1 time: 0.427964 Sep 07 13:19:55.284050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 225/457] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:54 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1502 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:55.318454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:55.319604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "826da7d3-44fd-4d04-9fa6-16bb95ca8842"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:55.323430 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:55.335053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a09ffa78-ebc3-4956-a417-7c34ca18d166 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.323833 Sep 07 13:19:55.335766 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 233/458] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:55 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:55.346269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.346765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.347378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.348111 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.348568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.348990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.442287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] HTTP exception thrown: Cannot 'attach_volume' instance 6e55303d-58ec-44db-a67c-2e9729dc076b while it is in vm_state rescued Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Request method failure captured: Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: POST /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b/os-volume_attachments HTTP/1.1 Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 74 Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm9eG3_FMKXY1fuUDokLMDxyDGowmvWbRnBlDdK22BwYh_6f_RELkSFM_FEGruAPKOTcGsxWHjI1mRJLoSQUuYe0vx-o8Ip1ws_SFZ9sH7CWvxVujnebCdulx5GeYf7zVZCt0zsVTBUlwMW8bL9UhKgSFefwcDauQbpcaNypmf4rYU Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:19:55.463389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d2ca3f0240b478e8463f74032a1b575"}]}] Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 406bdf61f9284ebc8620b21ee414ec91 Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {"volumeAttachment": {"volumeId": "826da7d3-44fd-4d04-9fa6-16bb95ca8842"}} Sep 07 13:19:55.465228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Cannot 'attach_volume' instance 6e55303d-58ec-44db-a67c-2e9729dc076b while it is in vm_state rescued Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'server_id': '6e55303d-58ec-44db-a67c-2e9729dc076b', 'body': {'volumeAttachment': {'volumeId': '826da7d3-44fd-4d04-9fa6-16bb95ca8842'}}} Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e55303d-58ec-44db-a67c-2e9729dc076b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:55.466192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6e55303d-58ec-44db-a67c-2e9729dc076b while it is in vm_state rescued Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:55.467605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:55.471331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:55.471331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:55.471331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6e55303d-58ec-44db-a67c-2e9729dc076b while it is in vm_state rescued Sep 07 13:19:55.471331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:19:55.471331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Returning 409 to user: Cannot 'attach_volume' instance 6e55303d-58ec-44db-a67c-2e9729dc076b while it is in vm_state rescued {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:55.471331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b2640f9d-c2d3-4581-96f9-14116848126a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.151493 Sep 07 13:19:55.471331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 226/459] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:19:55 2022] POST /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b/os-volume_attachments => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:19:55.478628 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:55.480196 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:55.488679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.489802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.490608 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.491852 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.492922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.493936 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.604560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ed5c80ee-68e0-4429-8f04-57abf38c1ce8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b/action" status: 202 len: 0 microversion: 2.1 time: 0.124028 Sep 07 13:19:55.613514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 234/460] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:19:55 2022] POST /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:19:55.624807 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:55.628815 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:55.652376 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.653631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.654393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.656168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.657357 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.658423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.682825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:55.683989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:55.696577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.696986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.697424 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.698231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.698834 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.699292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:56.501226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.501983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.514121 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-70cb9644-e074-4cc9-817c-cea2a0bf6e47 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1510 microversion: 2.1 time: 0.896989 Sep 07 13:19:56.515358 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 227/461] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:55 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1510 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:56.521409 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:56.522488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:56.545872 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.549547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:56.550428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.550874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:56.552058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:56.553701 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-28abe743-ceef-498c-9352-86734decbb0a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.874837 Sep 07 13:19:56.555969 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:56.557355 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:56.558586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 235/462] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:55 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:56.559127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:56.962811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.978568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ee6f690e-26c9-4247-ab2f-f564a9f894cc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.460567 Sep 07 13:19:57.027311 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 228/463] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:56 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:57.553959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:57.555320 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:57.575176 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:57.577588 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:57.578518 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:57.581451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:57.583451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:57.589160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:57.603994 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:57.605358 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:57.625694 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:57.626645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:57.627335 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:57.629207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:57.629924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:57.630591 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:58.101349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.112697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.119017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-487af016-3a04-4cd5-bc34-a9f0891dd734 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1510 microversion: 2.1 time: 0.568873 Sep 07 13:19:58.120220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 236/464] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:57 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:58.126231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:58.127125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:58.132257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.136162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.138579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:58.138952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f809d220-8876-4cea-ae81-1becf15344b2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.540359 Sep 07 13:19:58.139494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:58.140141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:58.140261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 229/465] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:57 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:58.141153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:58.141775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:58.142399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:58.356809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.362898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3901fbe-ba6b-4ad6-87dd-b1ed837309a1", "device": "/dev/sdb"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:58.368568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:58.375206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f16756d0-d5a5-429a-9aa7-98bcf9bf628e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.253539 Sep 07 13:19:58.376067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 237/466] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:58 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:58.381385 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:58.382718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:58.383921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:58.385454 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:58.386475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:58.387456 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.158016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:59.158901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:59.182173 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.182782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.183473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.184454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.185144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.187131 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.617409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:59.627176 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-405613de-25b8-4c32-a644-cc8d501d1154 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1510 microversion: 2.1 time: 0.476896 Sep 07 13:19:59.627810 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 238/467] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:59 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:59.644427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:59.645132 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:59.661125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.661125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.661594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.662234 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.662699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.663137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.974335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:00.005352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:00.007145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:00.008513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-641c0722-9c0b-4657-b91a-79022a260171 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.369205 Sep 07 13:20:00.021909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 239/468] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:59 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:00.043539 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:00.044388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:00.060938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.063500 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.064227 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:00.066376 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.066996 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.080229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:00.330838 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:00.342948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dcf38892-c749-4257-a0fc-5e11724a3ee9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.319228 Sep 07 13:20:00.343943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 240/469] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:00 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:00.658134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:00.659189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:00.667327 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.668223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.668957 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:00.671000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.671894 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.672543 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:01.109419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:01.122419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f25739b2-14d2-400d-a7fa-4adb042b9da2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "POST /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.771468 Sep 07 13:20:01.131478 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 230/470] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:19:58 2022] POST /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4/os-volume_attachments => generated 194 bytes in 2774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:20:01.131630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-71fa82c5-14f1-483e-a782-3badaaba87a0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1510 microversion: 2.1 time: 0.472388 Sep 07 13:20:01.131630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 241/471] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:00 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1510 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:01.137078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:01.138090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:01.153934 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:01.154442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:01.154880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:01.165746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:01.166174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:01.166616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:01.380547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:01.381178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:01.402739 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:01.413211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:01.413686 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:01.415308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:01.416892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:01.417307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:01.453858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:01.463067 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:01.469499 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:01.475254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1db8ea69-7a3d-4c9e-a387-907ecb8c4149 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.350840 Sep 07 13:20:01.476470 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 231/472] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:01 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:01.669610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:01.688246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4b925775-ba94-47e7-962d-b54ec38cf40f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.312154 Sep 07 13:20:01.707173 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 242/473] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:01 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:02.166058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:02.166810 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:02.176347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.180210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.182059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.183301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.183961 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.184543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.489638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.504150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2fdeda32-5695-4ffe-9c8b-3707480ae92d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1516 microversion: 2.1 time: 0.350028 Sep 07 13:20:02.519133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 232/474] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:02 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:02.519393 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:02.519393 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:02.546438 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.553601 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.554552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.556072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.557385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.558908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.773808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:02.775085 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:02.783563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.796152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.797666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.798704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.799444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.800118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.823951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.837501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.839609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.841785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:02.841973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-239cb26e-5b31-44bb-bd0d-f2e25181f818 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.339705 Sep 07 13:20:02.842454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 243/475] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:02 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:03.059424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:03.069284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-93a2e1f8-1f11-4cac-a2ee-bf70fad65efa tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.300111 Sep 07 13:20:03.071448 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 233/476] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:02 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:03.886111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:03.888415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:03.906795 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:03.908129 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:03.909216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:03.910673 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:03.912470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:03.913753 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.106090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:04.107995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:04.137340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:04.137719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:04.153760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.153760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:04.153760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:04.157674 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.202215 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.217332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.224303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.228651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3350a71d-519e-4814-a4e9-014d2663303c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.348722 Sep 07 13:20:04.231274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 244/477] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:03 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:04.327498 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f43fa943-d65c-4382-a2c5-ba1f0e09cd62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'create', calling method: .version_select at 0x7fa3db887af0>, body: {"keypair": {"name": "tempest-keypair-2076232612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU6c0r+IvKtPuozztw0cH53JNMCNvCfPpkKspUs4vr1hLtfUaKJZFIwfor2HMxxkEnBtljtl4B2x2hz483aOxJ30eLCLSTYJgaLIfUMjUhhBc993slOnlupq++zwsBBTQ=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:04.365403 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-f43fa943-d65c-4382-a2c5-ba1f0e09cd62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:20:04.372094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-f43fa943-d65c-4382-a2c5-ba1f0e09cd62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for user 406bdf61f9284ebc8620b21ee414ec91 and project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:20:04.398917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f43fa943-d65c-4382-a2c5-ba1f0e09cd62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [8274fed1-2755-47c2-a5c5-cc02ac00267a] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:20:04.514318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.527174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6f476e6a-0d49-4d26-99ec-c8414d6d0bde tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1722 microversion: 2.1 time: 0.427304 Sep 07 13:20:04.543135 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 234/478] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:04 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:05.267551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:05.267551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:05.273685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.274387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.274918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:05.275804 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.276444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.277020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:05.413445 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [None req-f43fa943-d65c-4382-a2c5-ba1f0e09cd62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [8274fed1-2755-47c2-a5c5-cc02ac00267a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 58426. Sep 07 13:20:05.448585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f43fa943-d65c-4382-a2c5-ba1f0e09cd62 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.130836 Sep 07 13:20:05.449520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 245/479] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:20:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:20:05.519663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:05.521258 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:05.522861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:05.524249 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1ff8e1d1-2431-4857-8aa5-5f2d2847970e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.270179 Sep 07 13:20:05.525009 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 235/480] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:05 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:05.564439 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:05.565900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:05.585596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.587873 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.592303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:05.594050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.594749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.595420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:06.110305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:06.132478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3ceed715-4f5a-422f-a337-f4618d90ff77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1699 microversion: 2.1 time: 0.574681 Sep 07 13:20:06.138746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 246/481] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:05 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1699 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:06.164504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-31cb32b0-4dd2-4f19-be64-a0c7a0fc43fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:06.176141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31cb32b0-4dd2-4f19-be64-a0c7a0fc43fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:06.177025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31cb32b0-4dd2-4f19-be64-a0c7a0fc43fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:06.177639 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31cb32b0-4dd2-4f19-be64-a0c7a0fc43fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:06.265758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-31cb32b0-4dd2-4f19-be64-a0c7a0fc43fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Going to try to start instance {{(pid=121070) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:20:06.392769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-31cb32b0-4dd2-4f19-be64-a0c7a0fc43fc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.232213 Sep 07 13:20:06.394563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 236/482] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:20:06 2022] POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:20:06.409757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:06.411076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:06.429494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:06.430989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:06.431723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:06.433600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:06.434496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:06.435477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:06.473767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:06.554914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:06.556397 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:06.571229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:06.575922 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:06.577209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:06.578524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:06.584647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:06.588313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:07.019281 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.035251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a6043e5c-d5d8-42c6-bc27-69e4ff8ef95a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1708 microversion: 2.1 time: 0.633680 Sep 07 13:20:07.036338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 247/483] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:06 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1708 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:07.270916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.285489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.288503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.290919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d1efa1f6-f29e-4100-b9ce-52c7ddd907ff tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1739 microversion: 2.20 time: 0.740647 Sep 07 13:20:07.292858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 237/484] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:06 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1739 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:08.080278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:08.080898 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:08.085049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:08.092493 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.093105 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.094198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.094969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.095579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.096028 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.106774 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-374657082", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38cbb300-e142-4750-9bd8-b00f8ec9be1d"}], "security_groups": [{"name": "tempest-securitygroup--299650872"}], "key_name": "tempest-keypair-2076232612", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:08.311653 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.320664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-91906644-e934-4996-9bc8-db3c045db594 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1708 microversion: 2.1 time: 0.244278 Sep 07 13:20:08.321265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 248/485] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:08 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1708 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:08.326074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:08.326719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:08.333239 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.333720 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.334156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.334841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.335327 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.335750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.467453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.475938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.477421 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.478874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e9616892-e56e-44b0-8a8c-46985ee08eec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1721 microversion: 2.20 time: 0.156412 Sep 07 13:20:08.479471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 249/486] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:08 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:09.344847 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:09.345597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:09.351821 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.352309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.352752 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.353708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.354169 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.354597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.587920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:09.596756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7153386f-e5d0-4dd2-8258-bd7271fab157 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1708 microversion: 2.1 time: 0.256348 Sep 07 13:20:09.612548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 250/487] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:09 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1708 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:09.617908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:09.618757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:09.627331 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.627998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.628508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.629203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.629742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.630211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.761903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:09.770627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:09.772130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:09.773281 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-73b3cddc-d693-4693-a808-49332bbc919d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1721 microversion: 2.20 time: 0.159409 Sep 07 13:20:09.773837 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 251/488] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:09 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:10.619127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:10.619741 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:10.626470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.626953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.627416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.628111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.628684 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.629108 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.765483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.773992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-24f2ed76-7024-408b-9e0a-f9924d9cf9d2 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1712 microversion: 2.1 time: 0.158575 Sep 07 13:20:10.774568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 252/489] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:10 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1712 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:10.798433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:10.799030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:10.805298 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.806028 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.806463 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.807185 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.807638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.808059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.947624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.956512 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.958041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.959312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2dad5e13-32a0-47a2-bf04-204560752d82 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1721 microversion: 2.20 time: 0.165018 Sep 07 13:20:10.959887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 253/490] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:10 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:11.169756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-23b7340e-9c56-4911-9ab3-675ee9870049 req-5caa2816-530a-470c-add9-bb1e42cbf018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa967676-e023-44fe-af50-47db2225c4c5", "name": "network-vif-unplugged", "status": "completed", "tag": "d09ff3be-283a-4f61-92b6-2a7fe58192db"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:11.180087 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-23b7340e-9c56-4911-9ab3-675ee9870049 req-5caa2816-530a-470c-add9-bb1e42cbf018 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:11.180640 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-23b7340e-9c56-4911-9ab3-675ee9870049 req-5caa2816-530a-470c-add9-bb1e42cbf018 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:11.181074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-23b7340e-9c56-4911-9ab3-675ee9870049 req-5caa2816-530a-470c-add9-bb1e42cbf018 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:11.192871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-23b7340e-9c56-4911-9ab3-675ee9870049 req-5caa2816-530a-470c-add9-bb1e42cbf018 service nova] Creating event network-vif-unplugged:d09ff3be-283a-4f61-92b6-2a7fe58192db for instance aa967676-e023-44fe-af50-47db2225c4c5 on hv-cinder-80403 Sep 07 13:20:11.198320 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-23b7340e-9c56-4911-9ab3-675ee9870049 req-5caa2816-530a-470c-add9-bb1e42cbf018 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032045 Sep 07 13:20:11.198778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 254/491] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:11.987573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:11.988377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:11.995999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:11.996508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:11.997328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:11.998143 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:11.998818 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:11.999558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.133962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:12.143303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:12.144745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:12.145901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-02e7f06d-2dea-4ac6-b608-1b6919eda0fd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1721 microversion: 2.20 time: 0.164073 Sep 07 13:20:12.146467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 255/492] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:11 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:13.172145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:13.172816 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:13.179017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:13.179522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:13.179956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:13.180639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:13.181084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:13.181534 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:13.318229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:13.326655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:13.328199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:13.329351 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1a73904c-f53c-4c30-8aa7-78ce322ac72d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1721 microversion: 2.20 time: 0.161617 Sep 07 13:20:13.329903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 256/493] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:13 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:14.355918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:14.356563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:14.363676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:14.364180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:14.364612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:14.365336 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:14.365796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:14.366232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:14.385739 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=4 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:14.507337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.516111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.517557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.518792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-be788f1b-bd34-48dc-ac5b-be5816d55dc0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1721 microversion: 2.20 time: 0.167334 Sep 07 13:20:14.519335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 257/494] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:14 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:15.545710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:15.546940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:15.554008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.554504 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.554954 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.556377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.556839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.557272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.716171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:15.726022 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:15.727892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:15.729083 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-15b56e07-df34-4abc-a7b7-da175785d555 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1724 microversion: 2.20 time: 0.187526 Sep 07 13:20:15.729661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 258/495] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:15 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:15.756094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a9d62cd-8a15-4f83-8de4-82e9bdd83ae1"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:15.758964 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:15.765589 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.766074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.766514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.767259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.767850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.768272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.128879 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-467abbbb-cae4-49e1-94a1-da05bc8ae8cb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.376770 Sep 07 13:20:16.136704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 259/496] 10.222.0.61 () {62 vars in 1364 bytes} [Wed Sep 7 13:20:15 2022] POST /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments => generated 188 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:20:16.339622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:16.340657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:16.353131 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:16.353954 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:16.354758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.357317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:16.360288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:16.360288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.429931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121069) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:20:16.496038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:16.516289 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9570d531-734f-4428-bb4b-73d138a4e1cf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/action" status: 202 len: 0 microversion: 2.20 time: 0.183570 Sep 07 13:20:16.516906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 260/497] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Sep 7 13:20:16 2022] POST /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:20:16.527412 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:16.528385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:16.535343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:16.535907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:16.536571 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.537650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:16.538844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:16.539482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.802921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:16.820645 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:16.822860 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:16.824706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-86b3d7fa-bf8c-401c-8b89-37ec281e952e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1810 microversion: 2.20 time: 0.303204 Sep 07 13:20:16.825422 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 261/498] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:16 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:17.279301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:17.851370 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:17.851978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:17.860146 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:17.860800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:17.861587 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:17.862929 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:17.863628 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:17.864120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:18.079409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.096553 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.098022 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.099496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-30827fc1-1853-43fc-848e-a6261d4f01e7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.252174 Sep 07 13:20:18.101800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 262/499] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:17 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:18.136424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=29 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:19.139842 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:19.140830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:19.149561 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.150160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.150650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:19.153374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.153374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.153374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:19.318442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:19.327863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:19.329384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:19.330806 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9b103a4c-d32f-41d7-afb5-c97b4ead77a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.195487 Sep 07 13:20:19.331851 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 263/500] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:19 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:20.361202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:20.362302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:20.368779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:20.369269 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:20.369714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:20.370426 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:20.370884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:20.371780 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:20.549945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:20.558785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:20.560298 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:20.562057 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a69d7464-4d5d-476c-817b-bbdca7050989 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.206943 Sep 07 13:20:20.562734 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 264/501] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:20 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:21.589797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:21.590448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:21.598092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:21.598578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:21.599009 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:21.599733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:21.600181 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:21.600600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:21.739207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.749518 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.751718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.753343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e9d64e60-3298-4915-8cc4-7d48f1bc72a6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.168634 Sep 07 13:20:21.753966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 265/502] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:21 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:22.782141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:22.782860 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:22.790088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.790725 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.791338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.792075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.792535 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.793202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.948076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.959278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.960740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.961907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ea727235-7ddc-4bda-b8a3-2edaec8e7633 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.184545 Sep 07 13:20:22.962474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 266/503] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:22 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:23.989861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:23.990567 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:23.998427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:23.999331 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:24.000136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:24.001303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:24.002177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:24.002619 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:24.161398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:24.170466 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:24.171943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:24.173217 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b30daf4b-5990-43bd-9799-f283809fc856 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.187714 Sep 07 13:20:24.174309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 267/504] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:23 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:25.200459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:25.201229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:25.208043 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:25.208576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:25.208983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:25.209948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:25.210266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:25.210721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:25.352546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.361870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.363366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.364531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fbbb50e8-b1b5-4d38-8783-9c330c0c5abc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.168067 Sep 07 13:20:25.365092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 268/505] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:25 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:26.390835 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:26.391528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:26.398068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:26.398548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:26.398980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:26.399698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:26.400146 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:26.400563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:26.551189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:26.560463 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:26.561950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:26.563125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cfc230ac-febf-4e6c-94fc-8033f9882a5f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.176865 Sep 07 13:20:26.563699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 269/506] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:26 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:27.593259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:27.593942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:27.601339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:27.601628 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:27.601967 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:27.602971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:27.603642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:27.604070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:27.768572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:27.778787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:27.781051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:27.782527 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2ce43d3b-d509-4f5d-ab06-6de15bc432f8 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.194707 Sep 07 13:20:27.783124 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 270/507] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:27 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:28.537673 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] validate_networks() for [('38cbb300-e142-4750-9bd8-b00f8ec9be1d', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:20:28.813732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:28.814581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:28.825252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:28.825868 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:28.826348 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:28.827674 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:28.828406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:28.830069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:29.073275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:20:29.073817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:20:29.075597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:20:29.077032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:20:29.078527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:20:29.094308 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:29.094966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:29.095355 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:29.096149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:29.096618 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:29.097056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:29.112133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:29.120702 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:20:29.122710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:29.124508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:29.125376 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Getting quotas for user 406bdf61f9284ebc8620b21ee414ec91 and project 2d2ca3f0240b478e8463f74032a1b575. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:20:29.125897 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8fb5f49e-bf30-438c-a577-cbb634653c32 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.320651 Sep 07 13:20:29.127145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 271/508] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:28 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:29.140756 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:20:29.143490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:20:29.201450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6231fd4c-54f5-4fa7-9726-465689bfcfbb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 21.098902 Sep 07 13:20:29.202668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 238/509] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:20:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 21101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:20:29.219841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d68d7b21-288e-441b-b96a-2699e9013579 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:29.220548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d68d7b21-288e-441b-b96a-2699e9013579 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:29.336677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d68d7b21-288e-441b-b96a-2699e9013579 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:29.345474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d68d7b21-288e-441b-b96a-2699e9013579 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1245 microversion: 2.1 time: 0.134976 Sep 07 13:20:29.346243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 272/510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:29 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:30.154516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:30.155146 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:30.163374 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:30.164345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:30.165005 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:30.166124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:30.166867 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:30.167685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:30.321475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:30.330426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:30.331989 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:30.333305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cc1f9806-f08e-4585-821d-49e6c1a94655 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.183385 Sep 07 13:20:30.335236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 239/511] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:30 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:30.374272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:30.374272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:30.380514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:30.381012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:30.381451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:30.382190 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:30.382641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:30.383068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:30.457448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:30.465534 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dd985db2-0297-4503-b861-8776115e4d32 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1249 microversion: 2.1 time: 0.096947 Sep 07 13:20:30.466127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 273/512] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:30 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:31.358817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:31.359439 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:31.366024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.366556 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.366942 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.367664 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.368113 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.368533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.488920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:31.489568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:31.497039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.498400 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.499210 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.500521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.501355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.502124 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.519186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:31.532453 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:31.535133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:31.537262 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e55441bf-04a9-4a47-b786-05d66debd844 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1750 microversion: 2.20 time: 0.182443 Sep 07 13:20:31.538220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 240/513] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:31 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:31.578020 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:31.588447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-00ac761f-1106-4fb3-820e-2884979755be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1249 microversion: 2.1 time: 0.103514 Sep 07 13:20:31.589075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 274/514] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:31 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:32.564985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:32.564985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:32.571449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.571947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.572440 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:32.573094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.573547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.573969 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:32.612069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:32.613233 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:32.620061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.620548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.621147 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:32.621874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.622499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.622955 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:32.709313 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:32.719615 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ee40aba7-c9d2-4b56-8b72-9aae5aa98052 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1297 microversion: 2.1 time: 0.111921 Sep 07 13:20:32.720293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 275/515] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:32 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:32.760018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:32.769330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:32.770786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:32.771987 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1732fdf5-eca2-4c19-a63f-7854166ce782 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1752 microversion: 2.20 time: 0.211855 Sep 07 13:20:32.772550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 241/516] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:32 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:33.744735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:33.745353 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:33.752325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:33.752811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:33.753273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:33.753973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:33.754416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:33.754840 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:33.799312 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:33.800253 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:33.807915 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:33.808519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:33.810472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:33.811777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:33.812612 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:33.813361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:33.865334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:33.873719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-71acbf0a-cd8b-4271-8d15-8317959ea3df tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1303 microversion: 2.1 time: 0.132869 Sep 07 13:20:33.874324 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 276/517] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:33 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:34.050364 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:34.059633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:34.061465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:34.062667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e3f36643-5b05-4bcb-bff7-19cba7cbeead tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1752 microversion: 2.20 time: 0.268478 Sep 07 13:20:34.079499 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 242/518] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:33 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1752 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:34.907678 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:34.908910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:34.917987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.919940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.920584 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.921906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.922636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.923277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:35.090840 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:35.091942 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:35.106120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:35.106941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:35.107701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:35.109208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:35.109978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:35.110834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:35.317063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:35.325373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8c34ba3f-99c1-4d47-b4a8-336a462c3160 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.422380 Sep 07 13:20:35.341320 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 277/519] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:34 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:35.582364 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:35.604480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:35.617163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:35.619330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cad04adb-5061-41b5-85e2-1c3323c85bf6 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1752 microversion: 2.20 time: 0.533245 Sep 07 13:20:35.643547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 243/520] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:35 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1752 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:36.033122 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-ab8709fd-5c64-44f3-bae7-7bf2ee8e1db1 req-61fbba15-4d62-4146-9719-f50d05046373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f47c9c-3c45-4ab9-aa2d-64f2e2683733", "tag": "eb225218-2745-41d3-a1a0-9cca41ac10b3"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:36.050311 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ab8709fd-5c64-44f3-bae7-7bf2ee8e1db1 req-61fbba15-4d62-4146-9719-f50d05046373 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.051377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ab8709fd-5c64-44f3-bae7-7bf2ee8e1db1 req-61fbba15-4d62-4146-9719-f50d05046373 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.052245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-ab8709fd-5c64-44f3-bae7-7bf2ee8e1db1 req-61fbba15-4d62-4146-9719-f50d05046373 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.066714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-ab8709fd-5c64-44f3-bae7-7bf2ee8e1db1 req-61fbba15-4d62-4146-9719-f50d05046373 service nova] Creating event network-changed:eb225218-2745-41d3-a1a0-9cca41ac10b3 for instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 on hv-cinder-80403 Sep 07 13:20:36.072942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-ab8709fd-5c64-44f3-bae7-7bf2ee8e1db1 req-61fbba15-4d62-4146-9719-f50d05046373 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046562 Sep 07 13:20:36.073684 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 278/521] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:36.353706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:36.354409 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:36.361328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.362143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.363494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.364563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.365052 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.365952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.622180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:36.630743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-be871568-a2d3-4d30-be58-25638cad9422 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.281962 Sep 07 13:20:36.631376 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 244/522] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:36 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:36.660080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:36.661927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:36.668682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.669275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.670339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.673245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.673245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.673245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.677358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:37.045607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:37.054614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:37.056120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:37.057327 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-25337547-2e95-4ebd-99f5-acdf1240a04d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.402053 Sep 07 13:20:37.057925 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 279/523] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:36 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:37.658621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:37.659420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:37.667913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.668496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.669002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.671613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.672857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.675937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.866222 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:37.866771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:37.873981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.874479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.874917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.876061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.876529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.876959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.949471 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:37.974482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-336d5f5d-35e5-453e-a12a-fdc1e3f80aaa tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.324302 Sep 07 13:20:37.991410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 245/524] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:37 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:38.062464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lazy-loading 'services' on Instance uuid 3c34f79c-8a91-4270-bcfc-43a41295b5c4 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:20:38.085593 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:38.087497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:38.093041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.093630 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.094128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.094981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.095747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.095879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.192979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-67e22433-ba36-4036-8c82-f0c7b4cf1bc1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4/os-volume_attachments/d3901fbe-ba6b-4ad6-87dd-b1ed837309a1" status: 202 len: 0 microversion: 2.1 time: 0.330646 Sep 07 13:20:38.195981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 280/525] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:20:37 2022] DELETE /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4/os-volume_attachments/d3901fbe-ba6b-4ad6-87dd-b1ed837309a1 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:20:38.252029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:38.261750 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:38.263328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:38.264592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f07284c3-a651-42b9-8213-b9d2d2fa9a54 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.183062 Sep 07 13:20:38.265048 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 246/526] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:38 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:39.001566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:39.002292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:39.004334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:39.010134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.010626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.011056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.011792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.012243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.012676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.174716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:39.183865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7bbdaca0-63e3-42ce-8c85-7a8eb3a82265 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.186971 Sep 07 13:20:39.184467 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 281/527] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:38 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:39.292985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:39.293588 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:39.296616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:39.297309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:39.303070 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.303612 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.304050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.304903 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.305236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.305672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.447667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:39.456805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:39.458589 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:39.459604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5831abd4-0cf5-402f-b35b-0b4fa26952e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.170564 Sep 07 13:20:39.460180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 247/528] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:39 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:40.210444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:40.211928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:40.216686 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:40.226879 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.227632 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.228305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.229252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.229929 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.230565 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.398519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:40.409159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-16fd1d6a-4394-4c49-8d23-fcc96b2e7329 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.204474 Sep 07 13:20:40.409734 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 282/529] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:40 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:40.486952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:40.489056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:40.495762 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.496264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.496937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.497929 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.498390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.498819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.692318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:40.702728 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:40.704538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:40.705927 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c30e56dc-6fb7-44bc-8be4-781f34f46457 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.222912 Sep 07 13:20:40.707014 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 248/530] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:40 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:41.437905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:41.438568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:41.446194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.446894 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.447541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.448460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.449075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.449751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.655449 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:41.672873 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bb55a4e8-f38f-4d07-aae9-93ad9798b193 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.239630 Sep 07 13:20:41.674519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 283/531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:41 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:41.732505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:41.733145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:41.742305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.743124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.744050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.745051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.745690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.746309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.964408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:41.974245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:41.976141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:41.977557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d7852bb9-27db-457b-a888-921a2c83d4f3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.249889 Sep 07 13:20:41.978299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 249/532] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:41 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:42.700841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:42.702441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:42.711224 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:42.711720 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:42.712162 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:42.712893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:42.713346 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:42.713775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:42.854750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:42.863019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-98e0f433-daba-43fe-92ee-31db1702cd3e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.166492 Sep 07 13:20:42.863713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 284/533] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:42 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:43.005727 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:43.006970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:43.015200 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.016507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.016947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.017653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.018242 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.018676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.190246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:43.202074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:43.203855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:43.205185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9e5510a5-2ab9-46f5-af19-c1774520cde0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.205508 Sep 07 13:20:43.206097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 250/534] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:42 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:43.888459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:43.889702 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:43.901685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.902364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.902985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.903738 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.904200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.904626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.084992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:44.107371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c86448e9-c8fe-419c-853c-c9b42888fb98 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.222447 Sep 07 13:20:44.107968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 285/535] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:43 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:44.109469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-886bf3b0-f502-4b07-a691-52c70e412efb req-af42d223-4dab-4478-93eb-7ab155a6faec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f47c9c-3c45-4ab9-aa2d-64f2e2683733", "name": "network-vif-plugged", "status": "completed", "tag": "eb225218-2745-41d3-a1a0-9cca41ac10b3"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:44.133401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-886bf3b0-f502-4b07-a691-52c70e412efb req-af42d223-4dab-4478-93eb-7ab155a6faec service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.133968 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-886bf3b0-f502-4b07-a691-52c70e412efb req-af42d223-4dab-4478-93eb-7ab155a6faec service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.134481 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-886bf3b0-f502-4b07-a691-52c70e412efb req-af42d223-4dab-4478-93eb-7ab155a6faec service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.147059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-886bf3b0-f502-4b07-a691-52c70e412efb req-af42d223-4dab-4478-93eb-7ab155a6faec service nova] Creating event network-vif-plugged:eb225218-2745-41d3-a1a0-9cca41ac10b3 for instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 on hv-cinder-80403 Sep 07 13:20:44.152800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-886bf3b0-f502-4b07-a691-52c70e412efb req-af42d223-4dab-4478-93eb-7ab155a6faec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047906 Sep 07 13:20:44.154113 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 251/536] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:44.233271 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:44.233880 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:44.240053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.240616 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.241120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.241809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.242258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.242677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.388666 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:44.399377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:44.401064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:44.402411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fc0cc9cd-dae2-401b-a0f1-fd63445355fe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.173834 Sep 07 13:20:44.403231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 286/537] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:44 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:45.130461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:45.131194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:45.138510 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.139013 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.139484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.140194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.140655 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.141276 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.285590 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:45.294259 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-91d790f7-5b55-469f-9f6c-331535a0313a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.167502 Sep 07 13:20:45.294889 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 252/538] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:45 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:45.429543 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:45.430166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:45.437348 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.437838 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.438278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.438979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.439660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.439885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.578698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:45.587694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:45.589139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:45.590336 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-219efcf3-ccda-4bc0-b23e-acbde8142a1c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.164910 Sep 07 13:20:45.591460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 287/539] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:45 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:46.318488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:46.319222 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:46.326675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.327306 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.327833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.328545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.329002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.329440 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.489090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:46.498580 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-60899bdf-d679-4bc6-b403-6c9b5241c764 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.183974 Sep 07 13:20:46.499454 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 253/540] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:46 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:46.618150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:46.618716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:46.626687 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.627302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.627861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.628716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.629179 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.629681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.776738 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:46.786029 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:46.787642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:46.788822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0406f963-1b1c-4b94-af2c-4ab2d3187fef tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.174773 Sep 07 13:20:46.789441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 288/541] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:46 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:47.523952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:47.524561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:47.532234 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.532897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.533598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.534503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.535133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.535749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.678204 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:47.686859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-59599877-f353-4cc2-b906-3c8503884e43 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.166654 Sep 07 13:20:47.690988 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 254/542] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:47 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:47.816892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:47.817777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:47.824544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.825667 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.826160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.826922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.827413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.827876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:48.008107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:48.020563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:48.022208 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:48.023575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-216fd597-84f5-4497-8cf3-c41c341594dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.210981 Sep 07 13:20:48.024150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 289/543] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:47 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:48.710693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:48.711433 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:48.718978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:48.719509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:48.719965 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:48.720673 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:48.721134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:48.721564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:48.871817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:48.875441 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:48.880789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-768d2759-9f5f-4ba2-9dcc-6ea1d2770cf3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.174417 Sep 07 13:20:48.881384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 255/544] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:48 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:49.051760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:49.052381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:49.059673 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.060159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.060638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:49.061296 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.061747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.062170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:49.213668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:49.232037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:49.233564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:49.234899 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c59d6ece-e4a6-43be-a7ea-4861c25241ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.187079 Sep 07 13:20:49.235610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 290/545] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:49 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:49.904016 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:49.904637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:49.911759 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.912255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.912700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:49.913402 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.913865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.914296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:50.057755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:50.073900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-88988cd5-f931-441b-be9e-4a5cdff16f2f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.173210 Sep 07 13:20:50.086557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 256/546] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:49 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:50.260572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:50.261380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:50.269851 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:50.270340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:50.270775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:50.271528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:50.272235 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:50.272590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:50.412082 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:50.421709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:50.423691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:50.425285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e525379e-63fe-4914-ae55-4ae72a788e87 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.168843 Sep 07 13:20:50.425856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 291/547] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:50 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:51.101435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:51.102147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:51.110081 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:51.110576 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:51.111014 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:51.111898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:51.112361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:51.112821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:51.262463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:51.271577 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-25c0565b-8e95-4ade-aba6-aad9d29d765d tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.174255 Sep 07 13:20:51.272180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 257/548] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:51 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:51.453203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:51.453924 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:51.460496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:51.460991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:51.461432 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:51.462137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:51.462593 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:51.463023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:51.612802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:51.622340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:51.623910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:51.625322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-374c58e4-e70b-4e10-ae61-3a41355fecdb tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.176584 Sep 07 13:20:51.625903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 292/549] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:51 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:52.295245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:52.296562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:52.303774 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.304181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.304615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.305322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.305773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.306190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.469029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:52.477465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a7199959-0e20-4268-82eb-9f9d01e49c03 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.186903 Sep 07 13:20:52.478045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 258/550] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:52 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:52.651494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:52.652106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:52.659261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.659761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.660209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.660914 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.661452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.661881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.804995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:52.813812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:52.815330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:52.816502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b18fc112-fc3b-4874-baf2-36ac862943f9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.169057 Sep 07 13:20:52.817066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 293/551] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:52 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:53.501489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:53.502137 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:53.509531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.510030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.510465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.511193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.511657 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.512149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.848293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:53.849041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:53.865100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.865863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.866458 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.867372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.867985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.868575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.898732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:53.909569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5aaa73f7-724d-4a88-98cd-fe5e485059c9 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.411886 Sep 07 13:20:53.916602 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 259/552] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:53 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:54.036267 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:54.052597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:54.055412 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:54.057614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a21f5c02-bd47-49f4-8435-899a6f9b74e2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.213133 Sep 07 13:20:54.058800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 294/553] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:53 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:54.935359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:54.935978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:54.944649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:54.944649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:54.945163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:54.945562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:54.946416 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:54.946552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:55.086162 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:55.087473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:55.096079 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:55.096622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:55.097199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:55.097909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:55.098364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:55.098794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:55.102020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:55.103979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:55.111717 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a7dc73a3-7228-4d41-b85c-d04ba0ce3bf4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.180857 Sep 07 13:20:55.112296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 260/554] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:54 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:55.280613 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:55.294520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:55.296059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:55.297267 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-562615b3-76b3-4344-9001-b8b2db262813 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.216254 Sep 07 13:20:55.297845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 295/555] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:55 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:56.138018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:56.139075 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:56.150446 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:56.151738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:56.152754 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:56.154094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:56.154961 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:56.156039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:56.306473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:56.315576 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-684d3e7a-6a90-4db5-9857-121f9584cd4a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.182033 Sep 07 13:20:56.327159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 261/556] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:56 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:56.327386 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:56.327386 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:56.333301 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:56.334357 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:56.335046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:56.336366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:56.336839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:56.338100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:56.523020 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:56.530617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:56.534231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:56.535896 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-11a396e1-eec9-4a1f-8c21-fb4d58e74907 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.214394 Sep 07 13:20:56.536767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 296/557] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:56 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:57.342144 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:57.342144 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:57.349452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:57.349958 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:57.350396 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:57.351408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:57.351873 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:57.352302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:57.517916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:57.526024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1605397b-8f82-4ebb-80d8-f21ca5acb352 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.190104 Sep 07 13:20:57.526614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 262/558] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:57 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:57.567566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:57.568475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:57.576288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:57.578817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:57.579566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:57.580519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:57.581231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:57.581867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:57.804721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:57.815728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:57.817058 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:57.818641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b96606ac-711e-4c67-8af3-e753bd2e0b7d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.257523 Sep 07 13:20:57.820097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 297/559] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:57 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:57.954944 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1369241856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-524724481", "security_groups": [{"name": "tempest-secgroup-smoke-1156289928"}], "block_device_mapping_v2": [{"uuid": "bf76f3f5-8368-4559-9c1f-720c7312d6cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "162da744-90cb-4ad5-9d57-0be2d76a9630"}]}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:58.087682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] validate_networks() for [('162da744-90cb-4ad5-9d57-0be2d76a9630', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:20:58.338330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:58.550553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:20:58.551075 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:20:58.551482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:20:58.551849 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:58.551964 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:20:58.552292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:20:58.552491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:58.558566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.559054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.559520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.560217 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.560669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.561115 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.561631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.562118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.562555 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.563335 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.563855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.564284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.582641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:20:58.586908 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for user 57896ea1ff2046d282fe47e2a8191676 and project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:20:58.658133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:20:58.662104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf76f3f5-8368-4559-9c1f-720c7312d6cd',volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:20:58.714600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:58.730909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3541dbbf-c9ad-4435-ad71-7d19dca6a556 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.184002 Sep 07 13:20:58.733124 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 298/560] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:58 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:58.830742 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5c12651e-5341-41e6-99dd-461ef6f7e03e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.878247 Sep 07 13:20:58.831796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 263/561] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:20:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:20:58.849827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:58.850248 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d4b16a25-5dcf-4058-84ce-31bab4961f6f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:58.851139 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:58.852199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d4b16a25-5dcf-4058-84ce-31bab4961f6f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:58.867175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.868388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.868663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.869822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.870851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.872129 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.960300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d4b16a25-5dcf-4058-84ce-31bab4961f6f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:58.977769 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d4b16a25-5dcf-4058-84ce-31bab4961f6f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1094 microversion: 2.1 time: 0.137885 Sep 07 13:20:58.978375 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 299/562] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:58 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1094 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:59.144196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:59.157087 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:59.158592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:59.159839 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d4c8e921-059b-4686-a33e-462287c316a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.316127 Sep 07 13:20:59.165510 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 264/563] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:58 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:59.776304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:59.776304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:59.776304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:59.776304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:59.777767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:59.777767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:59.777767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:59.777767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:59.929566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:59.937870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-434d103e-407a-4c5f-934e-8204536f0e2e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.176946 Sep 07 13:20:59.938450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 300/564] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:59 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:00.047624 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:00.048390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:00.057067 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.057590 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.058029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.058737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.059224 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.059652 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.124944 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:00.133001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-984e459d-81e5-4d96-b878-3f3aa3dcc554 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1144 microversion: 2.1 time: 0.089789 Sep 07 13:21:00.133590 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 265/565] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:00 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:00.192660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:00.193274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:00.200075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.200575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.201166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.201884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.202495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.202794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.356605 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:00.371979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:00.373457 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:00.374650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9e60d282-9cc3-47e8-87d3-149072755674 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.185999 Sep 07 13:21:00.375254 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 301/566] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:00 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:00.968452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:00.969611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:00.977336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.978137 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.978771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.979784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.980903 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.981622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:01.122245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:01.130524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-78959c74-c65f-41a3-a926-b2d39b439b82 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.168496 Sep 07 13:21:01.131093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 266/567] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:00 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:01.157253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:01.159063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:01.166054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:01.166538 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:01.166969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:01.167725 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:01.168174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:01.168728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:01.239684 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:01.248628 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-84b82a3e-f69b-43a7-8525-6326db05b59c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1136 microversion: 2.1 time: 0.095047 Sep 07 13:21:01.249215 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 302/568] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:01 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1136 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:01.404850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:01.404850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:01.409024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:01.409510 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:01.409952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:01.410649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:01.411119 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:01.411556 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:01.615243 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:01.640805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:01.645490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:01.649324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6570325e-4e2e-4835-bb1c-1082e330b0d0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.250808 Sep 07 13:21:01.655178 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 267/569] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:01 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:01.973239 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:01.974134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:01.988765 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:01.989968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:01.991025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:01.992465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:01.993519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:01.994436 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.071746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:21:02.167232 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:02.168380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:02.176059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.176807 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.177233 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.178099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.178546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.179184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.247908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-10168a73-e062-49ad-909f-ff09cec94f81 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 204 len: 0 microversion: 2.1 time: 0.283841 Sep 07 13:21:02.251645 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 303/570] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:21:01 2022] DELETE /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:21:02.259315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:02.260299 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:02.267416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.268288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.269844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.270841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.271843 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.272536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.420228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:02.430431 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-831df6d9-afc1-481e-8acd-45431c546a9e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1370 microversion: 2.1 time: 0.269436 Sep 07 13:21:02.431066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 268/571] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:02 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:02.436079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:02.436676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:02.442842 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.443359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.443796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.444489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.444937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.445361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.481991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:02.490247 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-177bcdaf-7e88-43e6-88e1-ccfd61b74e8f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1513 microversion: 2.1 time: 0.236725 Sep 07 13:21:02.491127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 304/572] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:02 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:02.522980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:02.532175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e3a16c54-65d1-4c88-b9c7-4e986c74ec5d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1192 microversion: 2.1 time: 0.099701 Sep 07 13:21:02.533017 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 269/573] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:02 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:02.678116 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:02.678934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:02.685065 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.685898 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.686877 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.687626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.688088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.688515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.849900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:02.860512 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:02.862003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:02.863223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9bd01f3f-4f83-41a3-b931-5bc55f10fc5a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.190150 Sep 07 13:21:02.863789 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 305/574] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:02 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:03.454036 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:03.454619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:03.461142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.461633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.462060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.462811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.463291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.463711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.514011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:03.514622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:03.521448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.521935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.522366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.523061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.523544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.523960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.651072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:03.660677 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fe2e1d88-3167-491f-b703-af2586ad72eb tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1564 microversion: 2.1 time: 0.210514 Sep 07 13:21:03.661282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 270/575] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:03 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1564 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:03.666012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:03.666622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:03.676183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.676685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.677210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.677953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.679156 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.679156 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.706733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:03.715745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fbef92bf-474c-4954-a295-7b2b66a49707 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1513 microversion: 2.1 time: 0.205352 Sep 07 13:21:03.716381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 306/576] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:03 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:03.721377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:03.721992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:03.730621 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.732575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.733134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.733964 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.734431 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.734887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.758751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:03.767214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-558d81f4-cb65-4cb4-a0c9-423cd2e75392 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1192 microversion: 2.1 time: 0.104439 Sep 07 13:21:03.767662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 271/577] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:03 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:03.818164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a595f64f-df88-4638-998b-1092e213cf1c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100429 Sep 07 13:21:03.818761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 307/578] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:21:03 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:03.896637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:03.898396 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:03.910007 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.911227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.912015 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:03.913387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:03.914393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:03.915309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:04.212535 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:04.244999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:04.249290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:04.251679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4016c581-8765-4053-b78c-b90e802f13a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.363243 Sep 07 13:21:04.252735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 272/579] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:03 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:04.703305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-cac907f7-e8fb-4ff6-9a0d-cabe9914b07b req-b77c6077-c153-4c9e-a3b9-78ccb5008d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa967676-e023-44fe-af50-47db2225c4c5", "name": "network-vif-plugged", "status": "completed", "tag": "d09ff3be-283a-4f61-92b6-2a7fe58192db"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:04.719477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-cac907f7-e8fb-4ff6-9a0d-cabe9914b07b req-b77c6077-c153-4c9e-a3b9-78ccb5008d22 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:04.720190 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-cac907f7-e8fb-4ff6-9a0d-cabe9914b07b req-b77c6077-c153-4c9e-a3b9-78ccb5008d22 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:04.720937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-cac907f7-e8fb-4ff6-9a0d-cabe9914b07b req-b77c6077-c153-4c9e-a3b9-78ccb5008d22 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:04.734994 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-cac907f7-e8fb-4ff6-9a0d-cabe9914b07b req-b77c6077-c153-4c9e-a3b9-78ccb5008d22 service nova] Creating event network-vif-plugged:d09ff3be-283a-4f61-92b6-2a7fe58192db for instance aa967676-e023-44fe-af50-47db2225c4c5 on hv-cinder-80403 Sep 07 13:21:04.740983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-cac907f7-e8fb-4ff6-9a0d-cabe9914b07b req-b77c6077-c153-4c9e-a3b9-78ccb5008d22 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042562 Sep 07 13:21:04.742283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 308/580] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:04.743931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:04.747350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:04.752533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:04.753346 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:04.753894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:04.754729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:04.755562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:04.756100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:04.761970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:04.791596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:04.792548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:04.799330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:04.799821 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:04.800256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:04.800978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:04.801407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:04.801829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:04.900559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:04.909539 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-13a65edf-73a7-4af6-b177-5858ba8ec859 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1192 microversion: 2.1 time: 0.123075 Sep 07 13:21:04.910128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 309/581] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:04 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1192 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:05.026281 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:05.034847 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-370e6561-7ee1-4327-96e3-89536f26decb tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1513 microversion: 2.1 time: 0.296806 Sep 07 13:21:05.050491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 273/582] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:04 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:05.181556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-2d71cc61-b954-46e8-8a66-dc2dfaa94275 req-2d0590a1-739b-4fd9-9efd-149960b183ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f47c9c-3c45-4ab9-aa2d-64f2e2683733", "tag": "eb225218-2745-41d3-a1a0-9cca41ac10b3"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:05.192234 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-2d71cc61-b954-46e8-8a66-dc2dfaa94275 req-2d0590a1-739b-4fd9-9efd-149960b183ab service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:05.192718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-2d71cc61-b954-46e8-8a66-dc2dfaa94275 req-2d0590a1-739b-4fd9-9efd-149960b183ab service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:05.193152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-2d71cc61-b954-46e8-8a66-dc2dfaa94275 req-2d0590a1-739b-4fd9-9efd-149960b183ab service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:05.205305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-2d71cc61-b954-46e8-8a66-dc2dfaa94275 req-2d0590a1-739b-4fd9-9efd-149960b183ab service nova] Creating event network-changed:eb225218-2745-41d3-a1a0-9cca41ac10b3 for instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 on hv-cinder-80403 Sep 07 13:21:05.210696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-2d71cc61-b954-46e8-8a66-dc2dfaa94275 req-2d0590a1-739b-4fd9-9efd-149960b183ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033763 Sep 07 13:21:05.211456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 310/583] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:05.288179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:05.288880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:05.296300 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:05.297290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:05.298068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:05.298982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:05.299658 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:05.300100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:05.468275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:05.478054 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:05.479599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:05.481368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f948ab86-d8ce-45b4-8237-385c09fa8cbc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.197117 Sep 07 13:21:05.481938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 274/584] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:05 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:05.935415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:05.936117 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:05.943335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:05.943850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:05.944301 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:05.945097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:05.945560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:05.945990 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:06.013888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:06.022484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1460de92-49a1-4d6b-9810-497fc50ad816 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1192 microversion: 2.1 time: 0.091645 Sep 07 13:21:06.023285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 311/585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:05 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:06.058365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:06.059476 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:06.066323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:06.066820 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:06.067436 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:06.068380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:06.069153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:06.069599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:06.231073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:06.258730 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-22145fd8-81ce-4b3a-9743-b1f531d5469f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1513 microversion: 2.1 time: 0.203828 Sep 07 13:21:06.259877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 275/586] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:06 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:06.508038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:06.508577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:06.515019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:06.515538 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:06.515975 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:06.516668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:06.517124 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:06.517548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:06.652251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:06.656113 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:06.662078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:06.663559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:06.664763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1d820579-d13d-479b-a58d-a2b60988304c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.160696 Sep 07 13:21:06.665290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 312/587] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:06 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:07.046408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:07.047010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:07.053077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.053564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.054002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.054693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.055175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.055613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.124062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:07.132445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a7b7d4ab-9a30-49bb-b424-0de3981c5967 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1192 microversion: 2.1 time: 0.090294 Sep 07 13:21:07.133015 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 276/588] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:07 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:07.283909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:07.284522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:07.292040 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.293062 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.293525 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.294219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.294673 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.295124 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.435145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:07.443650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0623fe4d-43ce-4598-8c10-c9960b018d14 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1513 microversion: 2.1 time: 0.163640 Sep 07 13:21:07.445101 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 313/589] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:07 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:07.694815 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:07.695359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:07.702084 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.702604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.703038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.703774 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.704318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.704754 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.899841 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:07.909878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:07.911350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:07.912526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-27da8eb7-6bd0-45c5-b57f-3f399c57494a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.222174 Sep 07 13:21:07.913096 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 277/590] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:07 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:08.060445 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-9dbb9557-6d56-497c-b26b-26a6d781fcf0 req-c7d6103f-ff0a-486f-915a-4b87cd5b0f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c34f79c-8a91-4270-bcfc-43a41295b5c4", "name": "network-vif-deleted", "tag": "1f60bf3d-7a70-49f9-932a-af22a4c4e53c"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:08.071012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9dbb9557-6d56-497c-b26b-26a6d781fcf0 req-c7d6103f-ff0a-486f-915a-4b87cd5b0f58 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:08.071530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9dbb9557-6d56-497c-b26b-26a6d781fcf0 req-c7d6103f-ff0a-486f-915a-4b87cd5b0f58 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:08.072143 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9dbb9557-6d56-497c-b26b-26a6d781fcf0 req-c7d6103f-ff0a-486f-915a-4b87cd5b0f58 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:08.094279 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-9dbb9557-6d56-497c-b26b-26a6d781fcf0 req-c7d6103f-ff0a-486f-915a-4b87cd5b0f58 service nova] Creating event network-vif-deleted:1f60bf3d-7a70-49f9-932a-af22a4c4e53c for instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 on hv-cinder-80403 Sep 07 13:21:08.101903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-9dbb9557-6d56-497c-b26b-26a6d781fcf0 req-c7d6103f-ff0a-486f-915a-4b87cd5b0f58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046301 Sep 07 13:21:08.102533 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 314/591] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:08.154107 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:08.154769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:08.162057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:08.162613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:08.163056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:08.163802 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:08.164259 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:08.164750 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:08.249002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:08.258628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f05a8201-d094-4717-95dc-470e820fc6be tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1200 microversion: 2.1 time: 0.108322 Sep 07 13:21:08.259509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 278/592] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:08 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:08.470314 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:08.471278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:08.479436 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:08.480449 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:08.480892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:08.481607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:08.482061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:08.482491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:08.550844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:08.559352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-00e449c9-5e2a-4438-a1d5-5f9ad34900a7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1304 microversion: 2.1 time: 0.094969 Sep 07 13:21:08.559938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 315/593] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:08 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:08.939637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:08.940245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:08.942140 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:08.942806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:08.948848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:08.949352 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:08.949793 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:08.950495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:08.950953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:08.951416 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:09.163616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:09.174465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:09.176121 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:09.177302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f66d9884-6fee-46c4-8dd8-95a406d07f60 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.242129 Sep 07 13:21:09.185828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 279/594] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:08 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:09.283662 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:09.284278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:09.286612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:09.287342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:09.294063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:09.294562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:09.295319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:09.296052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:09.296516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:09.296954 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:09.506351 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:09.515062 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b9cffe7d-6e4a-4165-be85-6c8a0dca6e68 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1210 microversion: 2.1 time: 0.235328 Sep 07 13:21:09.515706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 316/595] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:09 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1210 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:09.582232 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:09.583024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:09.589395 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:09.589985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:09.590499 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:09.591921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:09.592464 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:09.592976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:09.646451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:09.646451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:09.646451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:09.646451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lazy-loading 'fault' on Instance uuid 3c34f79c-8a91-4270-bcfc-43a41295b5c4 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:21:09.714712 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:09.728982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a2165298-8538-4a50-b87c-a0317f8f47e7 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1309 microversion: 2.1 time: 0.150738 Sep 07 13:21:09.729659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 280/596] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:09 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1309 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:10.207137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:10.208315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:10.219473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:10.221192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:10.221192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:10.222534 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:10.223796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:10.224700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:10.444293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:10.454875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:10.456417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:10.457624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d2a39ea2-8826-427b-ac92-3e2ea9ad2541 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1808 microversion: 2.20 time: 0.257763 Sep 07 13:21:10.458194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 317/597] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:10 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:21:10.538880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:10.539505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:10.547229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:10.547895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:10.549093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:10.549798 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:10.550567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:10.552708 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:10.721880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:10.730459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6e8e4c80-0853-4b74-811d-5ebbd5816dd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1278 microversion: 2.1 time: 0.195362 Sep 07 13:21:10.731086 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 281/598] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:10 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:10.759265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:10.760459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:10.771317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:10.772551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:10.773014 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:10.773856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:10.774320 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:10.774751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:10.811025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:10.811544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:10.811991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:10.812452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lazy-loading 'fault' on Instance uuid 3c34f79c-8a91-4270-bcfc-43a41295b5c4 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:21:10.858889 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:10.870885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-009fb7a7-c3c9-48f3-b7e5-f41f3489ebf6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1309 microversion: 2.1 time: 0.119034 Sep 07 13:21:10.874728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 318/599] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:10 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:11.490332 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:11.491663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:11.498795 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.499317 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.499834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.500687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.501146 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.501564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.666226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:11.677825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:11.679926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:11.683614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c50172de-df03-4b9c-9d45-27b635548458 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1795 microversion: 2.20 time: 0.195837 Sep 07 13:21:11.685575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 282/600] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:11 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1795 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:11.688152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-b94c33b0-adf2-4d4f-8142-17be140c60a0 req-7e780142-69a6-4907-8acb-244d097f1bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73983bde-1a9b-4a8b-aa02-2481c6e1d727", "tag": "56ce5a2d-ff39-49c0-ae86-ca2c874d86a1"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:11.708087 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b94c33b0-adf2-4d4f-8142-17be140c60a0 req-7e780142-69a6-4907-8acb-244d097f1bd8 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.708966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b94c33b0-adf2-4d4f-8142-17be140c60a0 req-7e780142-69a6-4907-8acb-244d097f1bd8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.709409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b94c33b0-adf2-4d4f-8142-17be140c60a0 req-7e780142-69a6-4907-8acb-244d097f1bd8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.731178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-b94c33b0-adf2-4d4f-8142-17be140c60a0 req-7e780142-69a6-4907-8acb-244d097f1bd8 service nova] Creating event network-changed:56ce5a2d-ff39-49c0-ae86-ca2c874d86a1 for instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 on hv-cinder-80403 Sep 07 13:21:11.736787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-b94c33b0-adf2-4d4f-8142-17be140c60a0 req-7e780142-69a6-4907-8acb-244d097f1bd8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053719 Sep 07 13:21:11.737447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 319/601] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:11.754799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:11.755777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:11.766198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.766967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.767454 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.768190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.768701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.769098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.902554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:11.903884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:11.910652 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.911164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.911600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.912296 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.912745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.913164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.915125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:11.926701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-eca220e4-51fc-40b3-b88d-b9004bfd1061 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.176079 Sep 07 13:21:11.927662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 283/602] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:11 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:11.964949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.965447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.965886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.966336 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lazy-loading 'fault' on Instance uuid 3c34f79c-8a91-4270-bcfc-43a41295b5c4 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:21:12.011513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:12.019844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-84464a66-9314-4534-bb27-4e93998e1db9 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 200 len: 1309 microversion: 2.1 time: 0.122522 Sep 07 13:21:12.020433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 320/603] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:11 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:12.964848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:12.965463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:12.971568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:12.972283 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:12.972722 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:12.973437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:12.973897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:12.974326 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:13.045038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:13.045591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 3c34f79c-8a91-4270-bcfc-43a41295b5c4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:13.052490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:13.053415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:13.053860 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:13.054609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:13.055075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:13.055526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] HTTP exception thrown: Instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 could not be found. Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Request method failure captured: Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 HTTP/1.1 Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJo2YhFUzCjyOey3utmv0JNCV0u1gMy-ytDjY8D5Hnm2Loowr6rO8KrcBLa5QSZU-HXpk39RosQpWK0Ce5Z7KaC8Pv3217eCBHNx3xuaVRbgHoc9QykWzNoEa9YMRPfQyvhxBg2GF20iGkvh65awgbBT4okoOBwU3G1K0JlFdcGRYAg Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: d916ed5ea0874a0f85089a99d4a66c12 Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesSnapshotTestJSON-824358418 Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:21:13.079745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d916ed5ea0874a0f85089a99d4a66c12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d916ed5ea0874a0f85089a99d4a66c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d916ed5ea0874a0f85089a99d4a66c12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d916ed5ea0874a0f85089a99d4a66c12"}]}] Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesSnapshotTestJSON-824358418 Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: d916ed5ea0874a0f85089a99d4a66c12 Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-824358418 Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesSnapshotTestJSON-824358418-project Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: d6083ed15f884ffea8550f28addcbfcd Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesSnapshotTestJSON-824358418-project Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 could not be found. Sep 07 13:21:13.084283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '3c34f79c-8a91-4270-bcfc-43a41295b5c4'} Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 could not be found. Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:21:13.085161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 could not be found. Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 could not be found. Sep 07 13:21:13.087945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:21:13.090419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Returning 404 to user: Instance 3c34f79c-8a91-4270-bcfc-43a41295b5c4 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:21:13.090419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-19e1b2be-abd9-473a-93e0-13ca2a50f8ca tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4" status: 404 len: 111 microversion: 2.1 time: 0.039760 Sep 07 13:21:13.097506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 321/604] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:13 2022] GET /compute/v2.1/servers/3c34f79c-8a91-4270-bcfc-43a41295b5c4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:21:13.159182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:13.168437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1879f469-199a-488a-9ba2-e8359482128d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.207537 Sep 07 13:21:13.169366 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 284/605] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:12 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:14.192528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:14.193051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:14.201369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.201857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.202294 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.202998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.203491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.203922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.355447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:14.363879 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7cee5f7c-79ba-419a-85b8-8ae676d0f647 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.175202 Sep 07 13:21:14.364486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 322/606] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:14 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:15.387659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:15.388399 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:15.395405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:15.395898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:15.396371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:15.397039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:15.397514 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:15.397931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:15.541145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:15.548844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-77fce4ed-c62f-444b-8ab6-c2d97bd791fb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.165655 Sep 07 13:21:15.549415 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 285/607] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:15 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:16.570907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:16.571544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:16.578442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.578940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.580132 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.580823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.581023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.721715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:16.729876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-db8ca07f-95f8-4ae3-9c4c-23e31c9a68fd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.162836 Sep 07 13:21:16.730452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 323/608] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:16 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:17.752489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:17.752998 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:17.759522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:17.760005 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:17.760442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:17.761130 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:17.761587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:17.762010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:17.892315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:17.900106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-859cbd70-4440-4bc9-9b68-a05b0c271cd9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.151596 Sep 07 13:21:17.900678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 286/609] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:17 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:18.934507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:18.935960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:18.942555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:18.943061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:18.943562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:18.944282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:18.944745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:18.945176 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:19.202395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:19.223262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-eeaf345d-5cc6-49a0-ba54-40f33cbc9ebd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.297702 Sep 07 13:21:19.240621 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 324/610] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:18 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:20.248663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:20.249630 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:20.257455 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:20.257949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:20.258388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:20.259094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:20.259574 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:20.260008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:20.401358 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:20.410237 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-55f7a559-34b7-482d-8760-cef606155197 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.165792 Sep 07 13:21:20.411095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 287/611] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:20 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:21.436745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:21.438143 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:21.444286 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:21.444969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:21.445518 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:21.446334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:21.446892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:21.447461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:21.593349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:21.601444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-033419a7-9795-4a9b-a3bb-139538305f3c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.168683 Sep 07 13:21:21.602019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 325/612] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:21 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:22.624887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:22.625485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:22.632034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:22.632517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:22.632945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:22.633631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:22.634077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:22.634492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:22.773864 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:22.782504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fb99f32c-3af8-4730-8f1f-18ecf564514c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.161461 Sep 07 13:21:22.783082 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 288/613] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:22 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:23.805552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:23.806142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:23.813202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:23.813703 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:23.814203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:23.814937 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:23.817154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:23.817154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:24.157106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:24.165410 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e82c10de-6996-4225-8fc1-24dc1fb56b26 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.363864 Sep 07 13:21:24.165942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 326/614] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:23 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:25.190074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:25.190804 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:25.197690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:25.198220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:25.198670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:25.199460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:25.200013 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:25.200382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:25.222625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=100 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:25.240172 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2020726718", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "networks": [{"uuid": "36f97f4f-1c7e-49fe-8c6d-4824f74f7dae"}]}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:25.306001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] validate_networks() for [('36f97f4f-1c7e-49fe-8c6d-4824f74f7dae', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:21:25.538295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:25.548460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f8e99cd8-1384-4639-aa30-7ba253508c04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.362643 Sep 07 13:21:25.549041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 289/615] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:25 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:25.788349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:21:25.788812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:21:25.789321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:21:25.789761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:21:25.790178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:21:25.799230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:25.799714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:25.800211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:25.800947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:25.801409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:25.801839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:25.818883 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Getting quotas for project d916ed5ea0874a0f85089a99d4a66c12. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:25.823515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Getting quotas for user d6083ed15f884ffea8550f28addcbfcd and project d916ed5ea0874a0f85089a99d4a66c12. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:25.835462 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:21:25.837758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:21:25.889128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-243c450a-b562-42fe-a2bd-4763d31da365 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653253 Sep 07 13:21:25.889786 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 327/616] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:21:25.901600 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-59a7ea21-d1dd-4578-a472-c903028617a1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:25.902295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-59a7ea21-d1dd-4578-a472-c903028617a1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:25.957206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-59a7ea21-d1dd-4578-a472-c903028617a1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:25.965053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-59a7ea21-d1dd-4578-a472-c903028617a1 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1219 microversion: 2.1 time: 0.068013 Sep 07 13:21:25.965526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 290/617] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:25 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:26.571609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:26.572220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:26.579129 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:26.579695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:26.580203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:26.580973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:26.581454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:26.581993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:26.766494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:26.775488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4a7cf1c1-037b-43c1-864d-9fb6d3698468 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.207665 Sep 07 13:21:26.777559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 328/618] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:26 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:26.989699 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:26.990323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:26.997536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:26.998028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:26.998468 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:26.999189 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:27.000077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:27.000531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:27.084493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:27.093024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a45f6095-5a25-4584-9f52-f1e62fa54eb4 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1271 microversion: 2.1 time: 0.108272 Sep 07 13:21:27.093709 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 291/619] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:26 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:27.800663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:27.801379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:27.808525 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:27.809232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:27.809847 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:27.810712 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:27.811186 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:27.811608 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:27.954134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:27.963264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1379154e-d7b9-4c49-bf0e-5cc36c3a4c17 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.166596 Sep 07 13:21:27.975249 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 329/620] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:27 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:28.118142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:28.118738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:28.125493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:28.125988 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:28.126424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:28.127148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:28.127612 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:28.128042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:28.199687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:28.207417 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-da863898-23a0-4278-be02-cc338920caa0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1277 microversion: 2.1 time: 0.093105 Sep 07 13:21:28.208570 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 292/621] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:28 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:28.991343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:28.991942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:28.999638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:29.000126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:29.000581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:29.001268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:29.001805 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:29.002153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:29.143000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:29.151473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a24748f3-1018-4c1d-b17a-0ed064559b4c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.163840 Sep 07 13:21:29.152064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 330/622] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:28 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:29.232127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:29.232954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:29.235378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:29.240647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:29.241141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:29.241581 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:29.242281 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:29.242768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:29.243334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:29.389143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:29.396742 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-84d06a00-fe0a-40d0-9e05-2e9fff04fe98 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.169040 Sep 07 13:21:29.397311 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 293/623] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:29 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:29.420530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-5d1ca7c2-18f3-4000-96c6-dd8d6d7958bb req-1d444c40-1aec-4b2e-bbb5-97609517e82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659cea91-67a5-429f-a732-df2c16418004", "tag": "54fb88cf-92e0-4712-97aa-76fa7e79d83c"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:29.429995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-5d1ca7c2-18f3-4000-96c6-dd8d6d7958bb req-1d444c40-1aec-4b2e-bbb5-97609517e82e service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:29.430570 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-5d1ca7c2-18f3-4000-96c6-dd8d6d7958bb req-1d444c40-1aec-4b2e-bbb5-97609517e82e service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:29.430997 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-5d1ca7c2-18f3-4000-96c6-dd8d6d7958bb req-1d444c40-1aec-4b2e-bbb5-97609517e82e service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:29.441760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-5d1ca7c2-18f3-4000-96c6-dd8d6d7958bb req-1d444c40-1aec-4b2e-bbb5-97609517e82e service nova] Creating event network-changed:54fb88cf-92e0-4712-97aa-76fa7e79d83c for instance 659cea91-67a5-429f-a732-df2c16418004 on hv-cinder-80403 Sep 07 13:21:29.447194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-5d1ca7c2-18f3-4000-96c6-dd8d6d7958bb req-1d444c40-1aec-4b2e-bbb5-97609517e82e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030202 Sep 07 13:21:29.448371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 331/624] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:29.832695 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-a4af35de-0c44-4da7-a0c4-c9bd42d4c9ab req-06c5f243-295a-4448-9312-1a6dc2da1fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73983bde-1a9b-4a8b-aa02-2481c6e1d727", "name": "network-vif-plugged", "status": "completed", "tag": "56ce5a2d-ff39-49c0-ae86-ca2c874d86a1"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:29.845257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a4af35de-0c44-4da7-a0c4-c9bd42d4c9ab req-06c5f243-295a-4448-9312-1a6dc2da1fd1 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:29.846263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a4af35de-0c44-4da7-a0c4-c9bd42d4c9ab req-06c5f243-295a-4448-9312-1a6dc2da1fd1 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:29.846805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a4af35de-0c44-4da7-a0c4-c9bd42d4c9ab req-06c5f243-295a-4448-9312-1a6dc2da1fd1 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:29.858704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-a4af35de-0c44-4da7-a0c4-c9bd42d4c9ab req-06c5f243-295a-4448-9312-1a6dc2da1fd1 service nova] Creating event network-vif-plugged:56ce5a2d-ff39-49c0-ae86-ca2c874d86a1 for instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 on hv-cinder-80403 Sep 07 13:21:29.864114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-a4af35de-0c44-4da7-a0c4-c9bd42d4c9ab req-06c5f243-295a-4448-9312-1a6dc2da1fd1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036044 Sep 07 13:21:29.864980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 294/625] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:30.175430 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:30.176024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:30.182230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.182706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.183705 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.184403 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.184849 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.185275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.189437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:30.329583 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:30.337710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-30cdb429-95a0-45eb-9747-3ac6de3a04d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.167145 Sep 07 13:21:30.338282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 332/626] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:30 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:30.422019 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:30.422711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:30.430117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.430536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.430981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.431719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.432840 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.433265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.582973 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:30.591381 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c1480a29-4632-4a9a-a75a-34643ad97a8a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.173763 Sep 07 13:21:30.591961 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 295/627] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:30 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:31.361101 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:31.361699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:31.368046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.368529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.368970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.369659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.370107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.370528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.503562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:31.511268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7284f7a9-84ee-456a-a511-2fad3544d45e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.153985 Sep 07 13:21:31.511851 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 333/628] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:31 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:31.614946 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:31.615567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:31.621936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.622405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.622821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.623535 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.623987 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.624404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.756844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:31.764879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-55a30765-b765-4849-b820-09d5768ccea2 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.153854 Sep 07 13:21:31.765459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 296/629] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:31 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:32.535417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:32.536059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:32.542871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.543743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.544362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.545195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.545653 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.546081 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.681737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:32.689374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5dd8ed3e-12c2-49b9-97f3-efff34ed0768 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.158167 Sep 07 13:21:32.689953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 334/630] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:32 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:32.787995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:32.788532 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:32.795803 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.796304 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.796752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.797478 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.797936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.798352 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.927434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:32.936111 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e44ebf69-0800-4db2-a73b-30d44e0e55e5 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.151857 Sep 07 13:21:32.936537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 297/631] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:32 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:33.712413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:33.713061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:33.719735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:33.720224 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:33.720713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:33.721422 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:33.721878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:33.722302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:33.869706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:33.878975 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0e0b32ec-7b9f-46eb-bc75-a4dc939d2e4f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1266 microversion: 2.1 time: 0.170360 Sep 07 13:21:33.879642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 335/632] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:33 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:33.959221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:33.959862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:33.966866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:33.967401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:33.967842 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:33.968547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:33.969131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:33.969710 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:34.119668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:34.128903 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-505d928d-9e61-4354-9e73-262a7844615a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.173531 Sep 07 13:21:34.129486 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 298/633] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:33 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:34.901654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:34.902330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:34.909278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:34.909765 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:34.910200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:34.910902 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:34.911376 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:34.911806 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.052578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.061809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b4d76b24-32d8-46b9-a096-d3837086b4bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1452 microversion: 2.1 time: 0.164294 Sep 07 13:21:35.062414 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 336/634] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:34 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:35.085445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:35.086056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:35.092856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.093564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.094121 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.094627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.095089 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.095545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.151629 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:35.152244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:35.158248 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.158738 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.159205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.159905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.160362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.160829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.268219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.276237 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e85a90b7-e820-4a3a-9960-7ba8efe3cfd8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1452 microversion: 2.1 time: 0.194667 Sep 07 13:21:35.276937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 299/635] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:35 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:35.317209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.325976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5b1d9859-d60c-4a76-a417-f769ac08543f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.178159 Sep 07 13:21:35.326532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 337/636] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:35 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:36.354370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:36.355069 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:36.357229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:36.363704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.364198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.364687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.365492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.365942 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.366359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.505206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:36.516369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b5590108-5a98-41ab-b7b6-4f49fdb847f0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.165843 Sep 07 13:21:36.524658 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 300/637] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:36 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:37.107366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-b65c73b6-9210-4a10-98ac-3d45c8f184be req-30670699-f900-4490-81fa-294b2b1cb07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73983bde-1a9b-4a8b-aa02-2481c6e1d727", "tag": "56ce5a2d-ff39-49c0-ae86-ca2c874d86a1"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:37.112528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:37.113621 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=6 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:37.122100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b65c73b6-9210-4a10-98ac-3d45c8f184be req-30670699-f900-4490-81fa-294b2b1cb07e service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.122695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b65c73b6-9210-4a10-98ac-3d45c8f184be req-30670699-f900-4490-81fa-294b2b1cb07e service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.123200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b65c73b6-9210-4a10-98ac-3d45c8f184be req-30670699-f900-4490-81fa-294b2b1cb07e service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.135952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-b65c73b6-9210-4a10-98ac-3d45c8f184be req-30670699-f900-4490-81fa-294b2b1cb07e service nova] Creating event network-changed:56ce5a2d-ff39-49c0-ae86-ca2c874d86a1 for instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 on hv-cinder-80403 Sep 07 13:21:37.145892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-b65c73b6-9210-4a10-98ac-3d45c8f184be req-30670699-f900-4490-81fa-294b2b1cb07e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042443 Sep 07 13:21:37.147605 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 338/638] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:37.540510 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:37.542635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:37.551072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.551911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.552631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.553695 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.554410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.555364 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.761393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:37.769885 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5f4a26fe-fb5b-445b-911f-ed6e7d223b9d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.234421 Sep 07 13:21:37.787428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 301/639] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:37 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:38.476583 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-e17d22a5-46f5-4806-9bda-70fbb62fd856 req-8cf30ee5-6d70-432c-8590-a509ca6d4863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659cea91-67a5-429f-a732-df2c16418004", "name": "network-vif-plugged", "status": "completed", "tag": "54fb88cf-92e0-4712-97aa-76fa7e79d83c"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:38.491012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e17d22a5-46f5-4806-9bda-70fbb62fd856 req-8cf30ee5-6d70-432c-8590-a509ca6d4863 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:38.491963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e17d22a5-46f5-4806-9bda-70fbb62fd856 req-8cf30ee5-6d70-432c-8590-a509ca6d4863 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:38.492170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e17d22a5-46f5-4806-9bda-70fbb62fd856 req-8cf30ee5-6d70-432c-8590-a509ca6d4863 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:38.505086 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-e17d22a5-46f5-4806-9bda-70fbb62fd856 req-8cf30ee5-6d70-432c-8590-a509ca6d4863 service nova] Creating event network-vif-plugged:54fb88cf-92e0-4712-97aa-76fa7e79d83c for instance 659cea91-67a5-429f-a732-df2c16418004 on hv-cinder-80403 Sep 07 13:21:38.510894 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-e17d22a5-46f5-4806-9bda-70fbb62fd856 req-8cf30ee5-6d70-432c-8590-a509ca6d4863 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039983 Sep 07 13:21:38.512116 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 339/640] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:38.797125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:38.797784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:38.804438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:38.804968 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:38.805423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:38.806226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:38.806690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:38.807497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:38.980759 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:38.993142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bb257d18-0b31-43b4-a884-50e28eec7f86 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.202632 Sep 07 13:21:38.994877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 302/641] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:38 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:40.020024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:40.020710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:40.022604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:40.028114 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:40.028749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:40.029170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:40.029857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:40.030307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:40.030725 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:40.171700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:40.179586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e36cb4c2-2498-40da-9ab8-735f8b0e5e2f tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.164115 Sep 07 13:21:40.180220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 340/642] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:40 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:41.204177 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:41.204788 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:41.211395 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.211885 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.212325 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.213017 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.213477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.213905 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.351358 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:41.359949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-89f14ee1-64e7-4c18-93ec-9c22811b071c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.159635 Sep 07 13:21:41.360749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 303/643] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:41 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:42.383793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:42.384434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:42.391286 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.391783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.392229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:42.392957 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.393409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.393838 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:42.528195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:42.536148 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bf66f420-f4f3-4f42-b2b0-720307e1877d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.156236 Sep 07 13:21:42.536746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 341/644] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:42 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:43.559475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:43.560090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:43.566215 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:43.566714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:43.567180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:43.567886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:43.568344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:43.568772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:43.708626 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:43.717284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3857bf34-ac60-45b0-bf18-9817ea09975c tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.161827 Sep 07 13:21:43.717926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 304/645] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:43 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:44.741483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:44.742059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:44.749080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:44.749570 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:44.750008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:44.750714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:44.751198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:44.751627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:44.908704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:44.922856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6464acad-28d4-4de7-97e4-6551e0b4f3dc tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.185222 Sep 07 13:21:44.923477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 342/646] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:44 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:45.945489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:45.946103 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:45.952865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:45.953345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:45.953773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:45.954490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:45.954940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:45.955406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:46.098118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:46.106949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9ad9de51-5c12-457c-8b0e-949f7c83a4c0 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1319 microversion: 2.1 time: 0.165277 Sep 07 13:21:46.107561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 305/647] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:45 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:47.131161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:47.131785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:47.138868 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:47.139397 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:47.139841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:47.140547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:47.141002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:47.141429 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:47.293244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:47.301951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-eddf3e93-554f-44ea-b997-96b62e8fc322 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1507 microversion: 2.1 time: 0.174687 Sep 07 13:21:47.302532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 343/648] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:47 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:47.327200 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7389d37d-4c93-4c56-9c1a-251013d66e93", "device": "/dev/sdb"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:47.329857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:47.336880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:47.337362 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:47.338386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:47.339074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:47.339958 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:47.340348 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:47.656971 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:47.675315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-983799a6-7284-48a9-963e-3c46439d3d23 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "POST /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352132 Sep 07 13:21:47.675929 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 306/649] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:21:47 2022] POST /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:55.966315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:55.966895 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:55.972970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:55.973462 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:55.974169 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:55.974874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:55.975362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:55.975793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:56.067121 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lazy-loading 'services' on Instance uuid 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:21:56.143936 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2bf25737-f88e-414a-9787-676fe9fd5b2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-volume_attachments/eab453e4-dac8-4f03-852a-ad17dac9f4bb" status: 202 len: 0 microversion: 2.1 time: 0.465641 Sep 07 13:21:56.144554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 344/650] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:21:55 2022] DELETE /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-volume_attachments/eab453e4-dac8-4f03-852a-ad17dac9f4bb => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:04.752110 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=27 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:04.752897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:04.757134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-078acf85-0859-4225-b744-5814b544c48a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:04.764913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-078acf85-0859-4225-b744-5814b544c48a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.765396 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-078acf85-0859-4225-b744-5814b544c48a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.765830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-078acf85-0859-4225-b744-5814b544c48a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.788294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-078acf85-0859-4225-b744-5814b544c48a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Going to try to stop instance {{(pid=121070) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:22:04.832367 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-078acf85-0859-4225-b744-5814b544c48a tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.081601 Sep 07 13:22:04.833191 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 307/651] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:22:04 2022] POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:04.843083 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:04.843811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:04.850990 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.851566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.852721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.853606 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.854323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.854851 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.859465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:04.993148 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:05.002118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bbd065b7-d98b-41ed-a978-163dfaf95851 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.164425 Sep 07 13:22:05.002695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 345/652] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:04 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:06.026181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:06.026878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:06.033441 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.033924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.034360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:06.035050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.035555 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.035979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:06.167290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:06.175040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2d9821b7-d784-4bcc-88a7-1874c0a628a1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.153646 Sep 07 13:22:06.175663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 308/653] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:06 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:07.197843 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:07.198492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:07.205050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:07.205530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:07.205965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:07.206651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:07.207126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:07.207543 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:07.353519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:07.362319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a9818600-b977-461e-b0c3-bfee4e7b1e06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.168366 Sep 07 13:22:07.363721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 346/654] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:07 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:08.386868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:08.387444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:08.393768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.394254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.394688 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.395407 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.395861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.396284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.524522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:08.532434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f6abdb0d-7caa-4da8-bc32-18314f3e6c77 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.149980 Sep 07 13:22:08.533003 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 309/655] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:08 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:09.557273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:09.558098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:09.564856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.565426 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.565773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.566469 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.566938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.567401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.710515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:09.718651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c48a1970-f4cf-4b5a-bbf8-afe746d7b1fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.167515 Sep 07 13:22:09.719245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 347/656] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:09 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:10.743469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:10.744072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:10.750437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.750972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.751451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.752138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.752619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.753056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.889049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:10.897344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3db6c4f9-2728-4a4e-a5d3-038627717d47 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.158395 Sep 07 13:22:10.897974 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 310/657] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:10 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:11.920439 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:11.921065 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:11.923360 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=16 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:11.928700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.929230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.929672 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:11.930871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.931373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.931844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.068487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:12.078567 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3220d03b-4b79-4bfd-84e2-2f6a12161c90 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.161968 Sep 07 13:22:12.079476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 348/658] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:11 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:12.441613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:12.442120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:12.449178 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.449669 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.450109 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.450803 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.451333 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.451760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.580630 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lazy-loading 'services' on Instance uuid 659cea91-67a5-429f-a732-df2c16418004 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:22:12.704816 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8c0e9b7a-94ca-4eec-afe2-7f2d375cfb1d tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "DELETE /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004/os-volume_attachments/7389d37d-4c93-4c56-9c1a-251013d66e93" status: 202 len: 0 microversion: 2.1 time: 0.266944 Sep 07 13:22:12.705419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 311/659] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:22:12 2022] DELETE /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004/os-volume_attachments/7389d37d-4c93-4c56-9c1a-251013d66e93 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:13.101358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:13.101989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:13.109071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:13.109551 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:13.110073 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:13.110842 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:13.111362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:13.111804 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:13.245198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:13.252982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-199610ff-6985-4267-82d3-736d783b696f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.155705 Sep 07 13:22:13.253560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 349/660] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:13 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:14.277604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:14.278303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:14.285868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.286288 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.286729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.287749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.288213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.288646 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.448852 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:14.457273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-af53c627-eb14-4535-badf-2e188c329f18 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.184669 Sep 07 13:22:14.457870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 312/661] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:14 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:14.914493 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:14.915790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:14.922814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.923345 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.923782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.924490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.924941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.925364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.958269 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:22:15.054679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a6c66fcc-e311-47b5-829a-1d7603865c41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "DELETE /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 204 len: 0 microversion: 2.1 time: 0.143770 Sep 07 13:22:15.058517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 350/662] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:22:14 2022] DELETE /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:22:15.064832 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:15.065461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:15.083456 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.084315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.085081 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.086342 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.087650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.088097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.236586 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:15.244511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-df8c15f2-2596-41e5-be81-03eea58ffe41 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1513 microversion: 2.1 time: 0.183868 Sep 07 13:22:15.245092 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 313/663] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:15 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:15.481797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:15.482432 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:15.488342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.488824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.489262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.489959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.490415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.490842 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.623689 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:15.631574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-297e6e08-c74e-4a09-afbc-f3b7da8d9679 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.154075 Sep 07 13:22:15.632203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 351/664] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:15 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:16.268119 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:16.268712 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:16.275796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.276287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.276749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.277427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.277884 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.278309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.421859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:16.429852 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fd99611c-a6df-4e14-b0a7-da7fda659150 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1513 microversion: 2.1 time: 0.165610 Sep 07 13:22:16.430423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 314/665] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:16 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:16.656334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:16.656888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:16.663825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.664365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.664898 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.665653 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.666195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.666630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.807845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:16.816969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-602c8abb-9c6e-42b1-a7a9-a16fea8924d5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.164647 Sep 07 13:22:16.817682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 352/666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:16 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:17.452539 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:17.453167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:17.459610 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.460090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.460527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.461199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.461653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.462069 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.596404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:17.604921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-58444c02-3b8c-4dd2-b88e-56f31f8777db tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1513 microversion: 2.1 time: 0.156336 Sep 07 13:22:17.605527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 315/667] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:17 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:17.844304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:17.844909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:17.851972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.853092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.853525 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.854212 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.854660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.855082 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.012919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:18.021552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b042c39f-c82b-4375-b5c1-33d9c9a23c7d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.181458 Sep 07 13:22:18.022271 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 353/668] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:17 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:18.632703 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.634432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:18.645909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.646805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.647690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.648977 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.649933 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.650628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.789515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:18.798469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ad251ae9-d2b1-4c67-88d4-a07da64fed2a tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1513 microversion: 2.1 time: 0.173114 Sep 07 13:22:18.799079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 316/669] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:18 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:19.046457 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:19.047050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:19.054345 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.054895 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.056148 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.056966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.058209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.058209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.201638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:19.209554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a43f0d1e-fc2c-4d78-b454-2697749fa118 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.166889 Sep 07 13:22:19.210164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 354/670] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:19 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:19.826361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:19.827049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:19.833684 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.834181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.834621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.835390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.835857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.836279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:20.045521 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:20.054805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-61eed167-7b9e-4a4a-bc16-ea05d7cfb1a6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1513 microversion: 2.1 time: 0.232527 Sep 07 13:22:20.056299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 317/671] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:19 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:20.234213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:20.234965 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:20.241249 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:20.241939 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:20.242377 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:20.243680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:20.244322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:20.244871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:20.299126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-85c4bff2-ca1b-42c9-96ed-37090d4325de req-90bdcaf7-47e2-4478-82c0-58efa266868f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659cea91-67a5-429f-a732-df2c16418004", "name": "network-vif-deleted", "tag": "54fb88cf-92e0-4712-97aa-76fa7e79d83c"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:20.310975 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-85c4bff2-ca1b-42c9-96ed-37090d4325de req-90bdcaf7-47e2-4478-82c0-58efa266868f service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:20.311444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-85c4bff2-ca1b-42c9-96ed-37090d4325de req-90bdcaf7-47e2-4478-82c0-58efa266868f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:20.311740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-85c4bff2-ca1b-42c9-96ed-37090d4325de req-90bdcaf7-47e2-4478-82c0-58efa266868f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:20.324652 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-85c4bff2-ca1b-42c9-96ed-37090d4325de req-90bdcaf7-47e2-4478-82c0-58efa266868f service nova] Creating event network-vif-deleted:54fb88cf-92e0-4712-97aa-76fa7e79d83c for instance 659cea91-67a5-429f-a732-df2c16418004 on hv-cinder-80403 Sep 07 13:22:20.329811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-85c4bff2-ca1b-42c9-96ed-37090d4325de req-90bdcaf7-47e2-4478-82c0-58efa266868f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161801 Sep 07 13:22:20.330388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 355/672] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:20.389192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:20.398192 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-eb020176-e411-4898-bab0-bacb27619d83 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.167866 Sep 07 13:22:20.398768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 318/673] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:20 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:21.081080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:21.081794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:21.089603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.090088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.090521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.091254 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.091702 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.092118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.126776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.127278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.127710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.128149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lazy-loading 'fault' on Instance uuid 659cea91-67a5-429f-a732-df2c16418004 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:22:21.173286 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6083ed15f884ffea8550f28addcbfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd916ed5ea0874a0f85089a99d4a66c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:21.181342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-20c63478-e4e9-495c-9348-539764899e73 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 200 len: 1309 microversion: 2.1 time: 0.104705 Sep 07 13:22:21.181919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 356/674] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:21 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:21.422247 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:21.422886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:21.429500 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.429990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.430993 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.431917 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.432373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.432817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.796767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:21.804533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1a631f78-54f8-4eff-9c92-90a26f70070f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.386350 Sep 07 13:22:21.805103 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 319/675] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:21 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:22.205242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:22.205844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] [instance: 659cea91-67a5-429f-a732-df2c16418004] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:22.212949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.213424 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.213856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.214616 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.215584 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.215584 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.229734 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] HTTP exception thrown: Instance 659cea91-67a5-429f-a732-df2c16418004 could not be found. Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Request method failure captured: Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 HTTP/1.1 Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJo2YhFUzCjyOey3utmv0JNCV0u1gMy-ytDjY8D5Hnm2Loowr6rO8KrcBLa5QSZU-HXpk39RosQpWK0Ce5Z7KaC8Pv3217eCBHNx3xuaVRbgHoc9QykWzNoEa9YMRPfQyvhxBg2GF20iGkvh65awgbBT4okoOBwU3G1K0JlFdcGRYAg Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: d916ed5ea0874a0f85089a99d4a66c12 Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesSnapshotTestJSON-824358418 Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:22:22.231396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d916ed5ea0874a0f85089a99d4a66c12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d916ed5ea0874a0f85089a99d4a66c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d916ed5ea0874a0f85089a99d4a66c12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d916ed5ea0874a0f85089a99d4a66c12"}]}] Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesSnapshotTestJSON-824358418 Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: d916ed5ea0874a0f85089a99d4a66c12 Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-824358418 Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesSnapshotTestJSON-824358418-project Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: d6083ed15f884ffea8550f28addcbfcd Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesSnapshotTestJSON-824358418-project Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 659cea91-67a5-429f-a732-df2c16418004 could not be found. Sep 07 13:22:22.232885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '659cea91-67a5-429f-a732-df2c16418004'} Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659cea91-67a5-429f-a732-df2c16418004 could not be found. Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:22.233688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659cea91-67a5-429f-a732-df2c16418004 could not be found. Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659cea91-67a5-429f-a732-df2c16418004 could not be found. Sep 07 13:22:22.235355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:22.236779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] Returning 404 to user: Instance 659cea91-67a5-429f-a732-df2c16418004 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:22.236779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9fd8bfba-85f2-4254-8689-209e1c7f84b6 tempest-VolumesSnapshotTestJSON-824358418 tempest-VolumesSnapshotTestJSON-824358418-project] 10.222.0.61 "GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004" status: 404 len: 111 microversion: 2.1 time: 0.031406 Sep 07 13:22:22.236779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 357/676] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:22 2022] GET /compute/v2.1/servers/659cea91-67a5-429f-a732-df2c16418004 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:22:22.828393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:22.829147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:22.835977 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.836469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.837558 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.838302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.838880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.839485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.972185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:22.981235 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7c673a5f-e193-4401-9863-b9520da8a560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.156657 Sep 07 13:22:22.981816 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 320/677] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:22 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:24.005735 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:24.006371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:24.013721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.014214 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.014657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.015405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.015867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.016297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.152474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:24.160177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4e5a109d-c41c-42e6-b9bc-3f3ea3075fd1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.158603 Sep 07 13:22:24.160742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 358/678] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:24 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:25.183485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:25.184087 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:25.190549 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:25.191033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:25.191494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:25.192184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:25.192638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:25.193059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:25.326291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:25.329767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:25.335018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d439d632-6501-4c90-8c8c-bfa5933d7f12 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.155904 Sep 07 13:22:25.335617 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 321/679] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:25 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:26.358281 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:26.358825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:26.365771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.366266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.366708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.367448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.367910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.368341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.504742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:26.512900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f625925f-c88a-4074-a4c4-5d580c224b06 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.158890 Sep 07 13:22:26.513502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 359/680] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:26 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:27.537736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:27.538257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:27.547666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:27.548156 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:27.548596 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:27.549294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:27.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:27.550182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:27.695931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:27.704611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6a4acfc9-3e3d-4a03-b149-ed37ba172b08 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.171779 Sep 07 13:22:27.705386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 322/681] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:27 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:28.729093 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:28.730217 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:28.736648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.737139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.737580 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:28.738284 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.738744 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.739200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:28.873419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:28.881308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7db2bc96-6f7d-4622-b663-3c64a7e40a02 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1676 microversion: 2.1 time: 0.156007 Sep 07 13:22:28.881891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 360/682] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:28 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:29.904502 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:29.905102 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:29.911525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:29.912033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:29.912452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:29.913140 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:29.913593 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:29.914014 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.049744 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:30.057868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-01c1a096-2395-452c-b773-243750c8e47c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1653 microversion: 2.1 time: 0.156974 Sep 07 13:22:30.058164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 323/683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:29 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:30.082989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e0bf05fa-6fb1-4e66-a620-12bb0427ada9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:30.089724 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e0bf05fa-6fb1-4e66-a620-12bb0427ada9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.090290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e0bf05fa-6fb1-4e66-a620-12bb0427ada9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.090795 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e0bf05fa-6fb1-4e66-a620-12bb0427ada9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.093484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:30.115537 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e0bf05fa-6fb1-4e66-a620-12bb0427ada9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Going to try to start instance {{(pid=121069) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:22:30.156929 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e0bf05fa-6fb1-4e66-a620-12bb0427ada9 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.077694 Sep 07 13:22:30.157507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 361/684] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:22:30 2022] POST /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:30.165459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:30.166061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:30.172531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.173012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.173447 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.174137 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.174585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.175001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.307647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:30.316322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-40544fd8-fd91-4573-93cb-b0d65ed3dc72 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1662 microversion: 2.1 time: 0.154578 Sep 07 13:22:30.316974 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 324/685] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:30 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:31.340257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:31.340869 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:31.347448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:31.347936 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:31.348372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:31.349072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:31.349791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:31.350215 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:31.486127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:31.494012 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1d6a3fc4-1d65-4ace-9aff-d9d523d84eda tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1662 microversion: 2.1 time: 0.158724 Sep 07 13:22:31.494585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 362/686] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:31 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:32.518166 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:32.518706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:32.525148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.525633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.526068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:32.526760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.527245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.527668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:32.656888 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:32.664704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a72108e7-6d5a-4d8e-9769-d42552b76c44 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1666 microversion: 2.1 time: 0.151133 Sep 07 13:22:32.665267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 325/687] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:32 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:38.416151 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:38.416820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:38.422920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.423444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.423886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.424584 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.425042 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.425473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.454995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-284c31b3-587b-4a31-bc79-e89c4ed152ee tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments/9a9d62cd-8a15-4f83-8de4-82e9bdd83ae1" status: 200 len: 194 microversion: 2.20 time: 0.144466 Sep 07 13:22:38.455609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 363/688] 10.222.0.61 () {60 vars in 1454 bytes} [Wed Sep 7 13:22:38 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments/9a9d62cd-8a15-4f83-8de4-82e9bdd83ae1 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:22:38.528065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:38.528829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:38.531313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=39 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:38.537784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.538285 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.538748 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.539498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.540008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.540438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.624541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lazy-loading 'services' on Instance uuid aa967676-e023-44fe-af50-47db2225c4c5 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:22:38.704000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-114281b9-df4a-477c-9571-8ad2a109d027 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments/9a9d62cd-8a15-4f83-8de4-82e9bdd83ae1" status: 202 len: 0 microversion: 2.20 time: 0.179845 Sep 07 13:22:38.705482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 326/689] 10.222.0.61 () {60 vars in 1457 bytes} [Wed Sep 7 13:22:38 2022] DELETE /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments/9a9d62cd-8a15-4f83-8de4-82e9bdd83ae1 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:22:38.713922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:38.721801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:38.728625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.729114 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.729557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.730266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.730834 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.731302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.761238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5f27f6ad-ff8d-4173-949e-f1e729a1f178 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051458 Sep 07 13:22:38.761802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 364/690] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Sep 7 13:22:38 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:22:39.775274 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:39.777633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:39.785047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.785576 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.786034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:39.786704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.787191 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.787616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:39.822221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b85111aa-5a65-4264-9166-bfe9ef5c5e1e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051703 Sep 07 13:22:39.822752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 327/691] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Sep 7 13:22:39 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:22:40.835407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:40.837568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:40.844208 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:40.844693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:40.845134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:40.845839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:40.846292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:40.846722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:40.881330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-66d782f7-d302-4f83-a356-4e93fc416097 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049952 Sep 07 13:22:40.881950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 365/692] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Sep 7 13:22:40 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:40.953451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:40.953959 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:40.960354 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:40.960854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:40.961267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:40.961950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:40.962393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:40.962812 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:40.989480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:22:41.063331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-22f481fb-1728-4503-90f7-6708462356ca tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 204 len: 0 microversion: 2.20 time: 0.113494 Sep 07 13:22:41.063918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 328/693] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Sep 7 13:22:40 2022] DELETE /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:22:41.079376 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:41.080176 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:41.087220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.087644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.088139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.088940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.089401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.089830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.223787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.232061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.233513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.234665 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bd86712c-0320-4ae7-88d3-c7f7133fafec tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.161862 Sep 07 13:22:41.235259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 366/694] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:41 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:42.261128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:42.261731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:42.268344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.268874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.269316 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.270041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.270522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.271001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.406687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:42.414974 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:42.416954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:42.418375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e8780cd1-b221-4440-bfb7-420d6be50d1d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.161727 Sep 07 13:22:42.418947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 329/695] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:42 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:43.445249 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:43.445893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:43.448312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:43.453694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:43.454182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:43.454625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:43.455358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:43.455823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:43.456275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:43.586730 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.594977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.596535 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.597698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cfe67f37-63c1-48d0-a3a8-c2927af8b7e0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.156973 Sep 07 13:22:43.598266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 367/696] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:43 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:44.623650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:44.624326 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:44.630806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.631321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.631756 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.632478 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.632958 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.633386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.766209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.774839 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.776505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.777660 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e7d2f87b-5e9a-4e15-ab8d-4cf4a8ee8a9e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1723 microversion: 2.20 time: 0.158151 Sep 07 13:22:44.778226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 330/697] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:44 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:45.705159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-71f7d148-e769-4bde-8b97-9f62728006f2 req-52278363-1d35-4693-94b6-747ad371b62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa967676-e023-44fe-af50-47db2225c4c5", "name": "network-vif-deleted", "tag": "d09ff3be-283a-4f61-92b6-2a7fe58192db"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:45.715941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-71f7d148-e769-4bde-8b97-9f62728006f2 req-52278363-1d35-4693-94b6-747ad371b62c service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.716469 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-71f7d148-e769-4bde-8b97-9f62728006f2 req-52278363-1d35-4693-94b6-747ad371b62c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.716859 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-71f7d148-e769-4bde-8b97-9f62728006f2 req-52278363-1d35-4693-94b6-747ad371b62c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.728727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-71f7d148-e769-4bde-8b97-9f62728006f2 req-52278363-1d35-4693-94b6-747ad371b62c service nova] Creating event network-vif-deleted:d09ff3be-283a-4f61-92b6-2a7fe58192db for instance aa967676-e023-44fe-af50-47db2225c4c5 on hv-cinder-80403 Sep 07 13:22:45.734680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-71f7d148-e769-4bde-8b97-9f62728006f2 req-52278363-1d35-4693-94b6-747ad371b62c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033604 Sep 07 13:22:45.735319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 368/698] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:45.804751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:45.805358 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:45.812238 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.812962 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.813398 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.814097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.814544 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.815169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.884525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:45.892845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:45.894911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:45.896134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b29626da-6f30-4044-9bf0-44265cbbeaaf tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 200 len: 1367 microversion: 2.20 time: 0.095380 Sep 07 13:22:45.896879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 331/699] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:45 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:46.921963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:46.922533 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:46.930511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:46.931247 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:46.932485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:46.934019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:46.934641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:46.935288 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:46.953969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] HTTP exception thrown: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Request method failure captured: Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 HTTP/1.1 Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJmtNZzsvdcXy8Zd2_alqhr6UV_eqHHx2xB3eTYy7L7N3rWxVDs6mxhnAwKGIvvqXHRUnaPpdH_zoH_rsbWOLteT420D0UZrfyzed0iYeZlkvuLOq6HMNteAKPj033tx8Exvd0QJ0MiHz1kr9CCf0rmtb-Wtu4-awob6bRBg-FMwCBs Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:22:46.955966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f1963d0789945fcbd182b7f2ce64d03"}]}] Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 181c888fbd454f00b049522fdfb4197e Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:22:46.957973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'aa967676-e023-44fe-af50-47db2225c4c5'} Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:46.958788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:22:46.960071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:22:46.962555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Returning 404 to user: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:46.963433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fce387cd-b95f-4b2a-b890-eedeb4612a63 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 404 len: 111 microversion: 2.20 time: 0.045794 Sep 07 13:22:46.964001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 369/700] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:46 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:22:46.977020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fb255526-5559-46ed-b7ab-9c4d8396c7b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '.version_select at 0x7fa3db6561f0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:47.002543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fb255526-5559-46ed-b7ab-9c4d8396c7b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440509267" status: 204 len: 0 microversion: 2.20 time: 0.032920 Sep 07 13:22:47.003758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 332/701] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Sep 7 13:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440509267 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:22:47.749315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2bdf531f-2b5b-4f0c-9432-f4ab85dab0d1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'create', calling method: .version_select at 0x7fa3db5d7e50>, body: {"keypair": {"name": "tempest-keypair-592434175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/kpCLfRKWrNQmMwwflyJ9gmfWgS2+y3Wvmaoi7QH5ddBqeT+e72RvGFsxhzZmXUjChJbY40TLAcKgF+o4Bze9NA9rZ3vUBtwBUPzpxXhDWZyc+b4DxVSPstpLtZXZZRQ=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:47.777545 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-2bdf531f-2b5b-4f0c-9432-f4ab85dab0d1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:22:47.786920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-2bdf531f-2b5b-4f0c-9432-f4ab85dab0d1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for user 181c888fbd454f00b049522fdfb4197e and project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:22:47.816865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2bdf531f-2b5b-4f0c-9432-f4ab85dab0d1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.071754 Sep 07 13:22:47.818139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 370/702] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Sep 7 13:22:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 13:22:49.171382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1341836024", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b34adbe1-953c-4c08-8e5b-71fafd005b90"}], "security_groups": [{"name": "tempest-securitygroup--575707482"}], "key_name": "tempest-keypair-592434175", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:49.276149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] validate_networks() for [('b34adbe1-953c-4c08-8e5b-71fafd005b90', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:22:49.744897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:22:49.745390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:22:49.745864 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:22:49.746273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:22:49.746686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:22:49.755381 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:49.755869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:49.756302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:49.757029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:49.757484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:49.757911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:49.775181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:22:49.779261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Getting quotas for user 181c888fbd454f00b049522fdfb4197e and project 3f1963d0789945fcbd182b7f2ce64d03. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:22:49.791356 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:22:49.793757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:22:49.842016 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1046f641-93a5-4c15-8133-b72011ed05d3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.676192 Sep 07 13:22:49.842849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 333/703] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Sep 7 13:22:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 13:22:49.855478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d6362cde-c6fe-4aae-b950-a4fe6f5fb0c3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:49.856118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d6362cde-c6fe-4aae-b950-a4fe6f5fb0c3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:49.918622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d6362cde-c6fe-4aae-b950-a4fe6f5fb0c3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:49.927450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d6362cde-c6fe-4aae-b950-a4fe6f5fb0c3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:49.928917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d6362cde-c6fe-4aae-b950-a4fe6f5fb0c3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:49.930027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d6362cde-c6fe-4aae-b950-a4fe6f5fb0c3 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1281 microversion: 2.20 time: 0.079218 Sep 07 13:22:49.930591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 371/704] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:49 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:50.954262 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:50.954869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:50.961620 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:50.962047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:50.962479 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:50.963198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:50.963653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:50.964184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:51.271053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:51.279448 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:51.280895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:51.281983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e1f07c19-164d-46ee-8815-82295c050cfd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1333 microversion: 2.20 time: 0.332102 Sep 07 13:22:51.282536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 334/705] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:50 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1333 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:52.313743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:52.315490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:52.325770 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.326590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.327209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:52.328317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.328933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.329698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:52.573845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:52.582669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:52.584183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:52.585307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-db6f56f8-6b9a-4795-8b3a-feec93e4e310 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.281954 Sep 07 13:22:52.585874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 372/706] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:52 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:52.983892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-eabdabf7-683b-4281-9dd9-57a0bffcbcfe req-9a6f15e8-075b-418e-a616-1752b7fd79bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38430858-246f-449d-9580-9747b3bf22e0", "tag": "d25ce013-3fdb-4ed2-9267-0c86e2ba62b0"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:52.994851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-eabdabf7-683b-4281-9dd9-57a0bffcbcfe req-9a6f15e8-075b-418e-a616-1752b7fd79bc service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.995490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-eabdabf7-683b-4281-9dd9-57a0bffcbcfe req-9a6f15e8-075b-418e-a616-1752b7fd79bc service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.995994 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-eabdabf7-683b-4281-9dd9-57a0bffcbcfe req-9a6f15e8-075b-418e-a616-1752b7fd79bc service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.008588 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-eabdabf7-683b-4281-9dd9-57a0bffcbcfe req-9a6f15e8-075b-418e-a616-1752b7fd79bc service nova] Creating event network-changed:d25ce013-3fdb-4ed2-9267-0c86e2ba62b0 for instance 38430858-246f-449d-9580-9747b3bf22e0 on hv-cinder-80403 Sep 07 13:22:53.013700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-eabdabf7-683b-4281-9dd9-57a0bffcbcfe req-9a6f15e8-075b-418e-a616-1752b7fd79bc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033545 Sep 07 13:22:53.014236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 335/707] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:22:53.610339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:53.610957 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:53.617450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.617941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.618384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.619084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.619628 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.620061 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.759415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:53.767607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:53.769604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:53.770779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-96920a3a-4789-44d5-90a9-3c514abf10aa tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.164429 Sep 07 13:22:53.771371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 373/708] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:53 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:53.810848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0232c02a-655a-41e5-844b-1823a9ef6566"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:53.813462 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:53.819809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.820297 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.820731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.821434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.821890 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.822426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.797816 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:54.798421 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:54.805579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.806068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.806505 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.807245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.807701 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.808127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.940619 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:54.948595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:54.950046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:54.951174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-74697354-b55e-43bc-b642-0ca68272061e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.157327 Sep 07 13:22:54.951733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 374/709] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:54 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:55.299666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a0f817b7-62c0-4de2-b2ed-b690d09c360b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.669449 Sep 07 13:22:55.301255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 336/710] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:22:53 2022] POST /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments => generated 194 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:22:55.976622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:55.977255 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:55.984259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:55.984779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:55.985253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:55.985959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:55.986417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:55.986850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.119790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:56.127941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:56.129514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:56.130617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-943a78ba-d74d-4b59-a570-da41ba6cd1a2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.158222 Sep 07 13:22:56.131199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 375/711] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:55 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:57.156599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:57.157284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:57.164645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.165131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.165566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.166258 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.166713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.167151 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.172736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:57.324183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:57.332383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:57.333838 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:57.334941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-911fc651-0872-480f-9dbb-b743598bdf30 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.182659 Sep 07 13:22:57.335786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 337/712] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:57 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:58.360281 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:58.360881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:58.368168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.368651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.369086 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.370373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.370826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.371290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.501688 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:58.510385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:58.511896 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:58.513098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0331fbb9-dd1f-4032-8ba9-3ac3fe787f40 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.156750 Sep 07 13:22:58.513662 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 376/713] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:58 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:59.539343 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:59.539956 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:59.546560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:59.547049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:59.547520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:59.548229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:59.548683 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:59.549118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:59.697138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:59.708417 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:59.709863 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:59.710967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e5265469-3596-4a52-96de-c1b27127ef98 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.176622 Sep 07 13:22:59.711598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 338/714] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:59 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:59.868017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-dc3909af-2d43-4e06-b587-54e156f8a79e req-c37938ce-82b8-48fe-93ed-f915c747ceb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38430858-246f-449d-9580-9747b3bf22e0", "name": "network-vif-plugged", "status": "completed", "tag": "d25ce013-3fdb-4ed2-9267-0c86e2ba62b0"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:59.877745 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-dc3909af-2d43-4e06-b587-54e156f8a79e req-c37938ce-82b8-48fe-93ed-f915c747ceb2 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:59.878223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-dc3909af-2d43-4e06-b587-54e156f8a79e req-c37938ce-82b8-48fe-93ed-f915c747ceb2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:59.879221 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-dc3909af-2d43-4e06-b587-54e156f8a79e req-c37938ce-82b8-48fe-93ed-f915c747ceb2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:59.891387 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-dc3909af-2d43-4e06-b587-54e156f8a79e req-c37938ce-82b8-48fe-93ed-f915c747ceb2 service nova] Creating event network-vif-plugged:d25ce013-3fdb-4ed2-9267-0c86e2ba62b0 for instance 38430858-246f-449d-9580-9747b3bf22e0 on hv-cinder-80403 Sep 07 13:22:59.897133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-dc3909af-2d43-4e06-b587-54e156f8a79e req-c37938ce-82b8-48fe-93ed-f915c747ceb2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102389 Sep 07 13:22:59.897734 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 377/715] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:00.736954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:00.737561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:00.739444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:00.740133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:00.746431 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:00.746921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:00.747383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:00.748084 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:00.748538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:00.748962 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:00.881621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:00.891905 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:00.893864 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:00.896064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1acdb390-c3a1-4fcf-b419-45c99bb5575a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.162859 Sep 07 13:23:00.896772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 339/716] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:00 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:01.919286 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=6 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:01.924052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:01.924756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:01.931468 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.931885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.932363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.933063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.933520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.933947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.936701 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:02.072184 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:02.080615 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:02.082628 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:02.083793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-053b5f46-b8cb-4959-9b9e-80b4867ad12f tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1406 microversion: 2.20 time: 0.165511 Sep 07 13:23:02.084458 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 378/717] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:01 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:03.109440 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:03.110045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:03.116711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.117201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.117633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.118341 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.118823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.119314 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.261966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:03.270260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:03.271757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:03.272909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4b9b05ea-07b3-46f4-87ce-63dc70893c1b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1597 microversion: 2.20 time: 0.167447 Sep 07 13:23:03.273475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 340/718] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:03 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1597 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:03.301553 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:03.302158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:03.308351 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.308829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.309257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.309952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.310393 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.310811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.392346 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cfb8847f-535e-48e1-92cd-4632200026c4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095282 Sep 07 13:23:03.392951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 379/719] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Sep 7 13:23:03 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:23:04.413230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-1390fd77-02dd-442f-b5d2-fc5b95108d74 req-15079c2f-315b-4dbb-8bb3-e20bdc94184a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38430858-246f-449d-9580-9747b3bf22e0", "tag": "d25ce013-3fdb-4ed2-9267-0c86e2ba62b0"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:04.424543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1390fd77-02dd-442f-b5d2-fc5b95108d74 req-15079c2f-315b-4dbb-8bb3-e20bdc94184a service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:04.425176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1390fd77-02dd-442f-b5d2-fc5b95108d74 req-15079c2f-315b-4dbb-8bb3-e20bdc94184a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:04.425608 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1390fd77-02dd-442f-b5d2-fc5b95108d74 req-15079c2f-315b-4dbb-8bb3-e20bdc94184a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:04.438120 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-1390fd77-02dd-442f-b5d2-fc5b95108d74 req-15079c2f-315b-4dbb-8bb3-e20bdc94184a service nova] Creating event network-changed:d25ce013-3fdb-4ed2-9267-0c86e2ba62b0 for instance 38430858-246f-449d-9580-9747b3bf22e0 on hv-cinder-80403 Sep 07 13:23:04.445690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-1390fd77-02dd-442f-b5d2-fc5b95108d74 req-15079c2f-315b-4dbb-8bb3-e20bdc94184a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036581 Sep 07 13:23:04.446422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 341/720] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:05.016781 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:05.019652 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:05.026865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:05.027875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:05.028496 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:05.029333 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:05.029794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:05.030224 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:05.060437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lazy-loading 'flavor' on Instance uuid 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:23:05.233763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-29648fa8-6be1-44ab-8216-4cb911fdb515 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/action" status: 200 len: 32 microversion: 2.1 time: 0.220001 Sep 07 13:23:05.242969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 380/721] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:23:05 2022] POST /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:23:05.252389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:05.254704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:05.263318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:05.264463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:05.265190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:05.266196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:05.266821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:05.267345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:05.493022 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:05.502044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f275519e-1a21-47c3-b2d9-3577fed55e06 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.257106 Sep 07 13:23:05.502785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 342/722] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:05 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:06.527083 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:06.527896 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:06.534626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:06.535902 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:06.536508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:06.537515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:06.538146 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:06.538703 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:06.682063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:06.692142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-26fec3b7-978d-4340-aaed-fba05673c36f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.169297 Sep 07 13:23:06.692722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 381/723] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:06 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:07.715825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:07.716420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:07.723924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:07.724421 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:07.724861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:07.725565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:07.726275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:07.726728 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:07.860843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:07.869319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-479085db-e44f-4f5f-adda-e7560be25339 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.157301 Sep 07 13:23:07.869894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 343/724] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:07 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:08.892623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:08.893239 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:08.899801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:08.900285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:08.900723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:08.901607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:08.902066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:08.902494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:09.050876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:09.059922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-531f9e46-54f0-443a-b112-185a39836da8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.171233 Sep 07 13:23:09.060508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 382/725] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:08 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:10.084266 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:10.084872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:10.087470 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:10.093854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:10.094345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:10.094780 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:10.095531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:10.095979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:10.096404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:10.235547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:10.244494 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2bc9490d-84cf-417a-8a1d-8a7cbc299b3f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.164129 Sep 07 13:23:10.245065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 344/726] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:10 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:11.268661 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:11.269309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:11.277216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:11.277741 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:11.278187 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:11.278918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:11.279530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:11.279970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:11.442709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:11.456926 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f0f83d27-8b35-41c6-9825-8ca2625fd2ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.192284 Sep 07 13:23:11.458140 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 383/727] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:11 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:12.482488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:12.483294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:12.491649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:12.492321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:12.492771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:12.493482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:12.494251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:12.494435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:12.661736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:12.670330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-34bb6428-eb2b-4fb2-98f8-773dcdf137a2 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.191679 Sep 07 13:23:12.670847 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 345/728] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:12 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:13.699727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:13.700282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:13.702733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:13.707990 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:13.708482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:13.709424 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:13.710117 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:13.710573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:13.711002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:13.845887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:13.855366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cd535ba3-0a93-45f0-8e9c-25dcb737da53 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.159517 Sep 07 13:23:13.856030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 384/729] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:13 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:14.877923 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:14.878526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:14.885116 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:14.885598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:14.886032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:14.886715 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:14.887190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:14.887611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:15.020166 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:15.028638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bd25b1f3-e95d-4e68-bf52-8a9cc27a4919 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.154553 Sep 07 13:23:15.029213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 346/730] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:14 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:16.052381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:16.052979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:16.059442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:16.059929 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:16.060369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:16.061067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:16.061528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:16.061954 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:16.197672 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:16.206326 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-89bbe2aa-a7c7-4e42-8449-dd06ecdfc940 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.157889 Sep 07 13:23:16.206916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 385/731] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:16 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:17.229988 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:17.230784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:17.237565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:17.238331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:17.238983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:17.240023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:17.240487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:17.240902 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:17.381562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:17.390260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-69d2d6be-7acc-4416-b97e-f2f5ede7080f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.164587 Sep 07 13:23:17.390851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 347/732] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:17 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:18.414102 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:18.414757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:18.421265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:18.421750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:18.422188 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:18.422889 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:18.423374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:18.423798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:18.568694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:18.577206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b7bc5800-987b-462f-9139-7d3fb6112553 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.167004 Sep 07 13:23:18.578091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 386/733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:18 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:19.600894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:19.601756 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:19.608259 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:19.608747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:19.609184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:19.609873 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:19.610326 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:19.610749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:19.749774 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:19.758520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ac164849-bd87-4e45-bc98-ff5b9e8f77ae tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.162054 Sep 07 13:23:19.759176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 348/734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:19 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:20.782693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:20.783321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:20.789733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:20.790211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:20.790648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:20.791363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:20.791814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:20.792234 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:20.923250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:20.932104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c3b11a17-596c-4345-855d-ac14998f30be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.153773 Sep 07 13:23:20.932654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 387/735] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:20 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:21.955132 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:21.955743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:21.962773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:21.963285 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:21.963716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:21.964404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:21.964878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:21.965299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:22.098936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:22.109290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-54716e84-11f1-45c4-94b4-345cf06414a5 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.157963 Sep 07 13:23:22.109862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 349/736] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:21 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:23.132519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:23.133135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:23.140075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:23.140530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:23.140972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:23.141986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:23.142139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:23.142577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:23.284694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:23.293238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b626c86b-5564-40b4-b617-3539166bdf0f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.165045 Sep 07 13:23:23.293829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 388/737] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:23 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:24.317304 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:24.317917 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:24.325511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:24.326108 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:24.326549 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:24.327294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:24.327758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:24.328194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:24.474608 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:24.488675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-31519241-29f2-464e-aefe-3e4ea04f33b8 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.175205 Sep 07 13:23:24.489279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 350/738] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:24 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:25.512909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:25.513633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:25.523426 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:25.524484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:25.524484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:25.525073 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:25.525531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:25.525960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:25.669319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:25.677895 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c2d3b312-5015-47b4-b398-6065d86b3f6c tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1734 microversion: 2.1 time: 0.169125 Sep 07 13:23:25.679075 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 389/739] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:25 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:26.705375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:26.706139 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:26.713582 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:26.714186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:26.714579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:26.715326 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:26.715781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:26.716207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:26.854256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:26.862465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-583c7951-f396-4c39-9a69-34899d0e814a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1714 microversion: 2.1 time: 0.162113 Sep 07 13:23:26.863032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 351/740] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:26 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:26.924726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:26.925219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:26.932259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:26.933085 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:26.933523 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:26.934214 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:26.934680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:26.935088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:27.026901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] HTTP exception thrown: Cannot 'detach_volume' instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 while it is in vm_state rescued Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Request method failure captured: Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments/0232c02a-655a-41e5-844b-1823a9ef6566 HTTP/1.1 Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJm9eG3_FMKXY1fuUDokLMDxyDGowmvWbRnBlDdK22BwYh_6f_RELkSFM_FEGruAPKOTcGsxWHjI1mRJLoSQUuYe0vx-o8Ip1ws_SFZ9sH7CWvxVujnebCdulx5GeYf7zVZCt0zsVTBUlwMW8bL9UhKgSFefwcDauQbpcaNypmf4rYU Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:23:27.028562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d2ca3f0240b478e8463f74032a1b575"}]}] Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 406bdf61f9284ebc8620b21ee414ec91 Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:23:27.030189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Cannot 'detach_volume' instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 while it is in vm_state rescued Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'server_id': '35f47c9c-3c45-4ab9-aa2d-64f2e2683733', 'id': '0232c02a-655a-41e5-844b-1823a9ef6566'} Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:23:27.031067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 while it is in vm_state rescued Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 while it is in vm_state rescued Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:27.032383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Returning 409 to user: Cannot 'detach_volume' instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 while it is in vm_state rescued {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:23:27.033491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d3348e81-1df7-4ca7-9f47-6eae304ecb17 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments/0232c02a-655a-41e5-844b-1823a9ef6566" status: 409 len: 152 microversion: 2.1 time: 0.109279 Sep 07 13:23:27.033491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 390/741] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:23:26 2022] DELETE /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments/0232c02a-655a-41e5-844b-1823a9ef6566 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:23:27.040423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:27.041027 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:27.046954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:27.047475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:27.047907 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:27.048592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:27.049039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:27.049458 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:27.118895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bb5a2f9f-afaa-4931-aa69-e3ae97aabf73 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "POST /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/action" status: 202 len: 0 microversion: 2.1 time: 0.082691 Sep 07 13:23:27.122086 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 352/742] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:23:27 2022] POST /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:23:27.128258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:27.128875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:27.136734 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:27.137198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:27.137649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:27.138343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:27.138823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:27.139266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:27.286918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:27.297116 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3194252f-8c3c-4628-beb9-e07c39ff243f tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1722 microversion: 2.1 time: 0.172364 Sep 07 13:23:27.297700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 391/743] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:27 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:28.323627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:28.324281 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:28.330928 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:28.331659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:28.332291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:28.333128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:28.333644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:28.334131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:28.337933 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:28.480386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:28.489025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fb575775-1a59-4615-952d-2ec4625badb3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1722 microversion: 2.1 time: 0.170881 Sep 07 13:23:28.489606 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 353/744] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:28 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:29.512612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:29.513384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:29.522885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:29.523420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:29.523856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:29.524575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:29.525026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:29.525450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:29.667808 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:29.677255 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-64bf776e-e9cd-4f83-b9d3-9cc19ad85420 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1722 microversion: 2.1 time: 0.168476 Sep 07 13:23:29.677990 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 392/745] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:29 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:30.703633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:30.704422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:30.711373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:30.711897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:30.712342 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:30.713061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:30.713523 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:30.713953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:30.871206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:30.880104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-30b2f20d-9d7a-40c3-a1ed-1c1e8bbfe861 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1728 microversion: 2.1 time: 0.181042 Sep 07 13:23:30.880708 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 354/746] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:30 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:30.906617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:30.907365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:30.914322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:30.914820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:30.915347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:30.916018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:30.916472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:30.917049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:30.919900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:31.018507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-83b1d2ea-5fbd-4e34-8419-d2f924abe1ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117754 Sep 07 13:23:31.019188 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 393/747] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:23:30 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:32.016274 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-a83ea255-2347-4478-9a0e-eba2ee3210d8 req-c383377d-a1c7-415c-abc0-139a531950c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f47c9c-3c45-4ab9-aa2d-64f2e2683733", "tag": "eb225218-2745-41d3-a1a0-9cca41ac10b3"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:32.028585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a83ea255-2347-4478-9a0e-eba2ee3210d8 req-c383377d-a1c7-415c-abc0-139a531950c2 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:32.029297 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a83ea255-2347-4478-9a0e-eba2ee3210d8 req-c383377d-a1c7-415c-abc0-139a531950c2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:32.029818 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a83ea255-2347-4478-9a0e-eba2ee3210d8 req-c383377d-a1c7-415c-abc0-139a531950c2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:32.044880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-a83ea255-2347-4478-9a0e-eba2ee3210d8 req-c383377d-a1c7-415c-abc0-139a531950c2 service nova] Creating event network-changed:eb225218-2745-41d3-a1a0-9cca41ac10b3 for instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 on hv-cinder-80403 Sep 07 13:23:32.052745 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-a83ea255-2347-4478-9a0e-eba2ee3210d8 req-c383377d-a1c7-415c-abc0-139a531950c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038897 Sep 07 13:23:32.053818 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 355/748] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:23:32.673605 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:32.676947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:32.689826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:32.691184 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:32.692253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:32.693595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:32.694986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:32.695814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:32.739202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-be6658f7-a4a9-414a-92d0-556ed85d2211 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073390 Sep 07 13:23:32.740282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 394/749] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:23:32 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:23:32.829480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:32.830905 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:32.842849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:32.843939 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:32.844834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:32.846203 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:32.847176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:32.848057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:32.890179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:23:32.988653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-552457b0-83fc-4dac-9c37-27ef8df34668 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 204 len: 0 microversion: 2.1 time: 0.166531 Sep 07 13:23:32.992212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 356/750] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:23:32 2022] DELETE /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:23:33.002152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:33.003066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:33.011044 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:33.011576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:33.012017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:33.012919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:33.013382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:33.013811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:33.187971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:33.196973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c99c0abe-e509-490d-ab1b-f936efd6eced tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1672 microversion: 2.1 time: 0.200309 Sep 07 13:23:33.197598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 395/751] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:32 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:34.075229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-c5cc47e1-62ba-461f-b3b7-edd6d74d4586 req-660b8118-dc02-4770-b4f8-2851142f6b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f47c9c-3c45-4ab9-aa2d-64f2e2683733", "tag": "eb225218-2745-41d3-a1a0-9cca41ac10b3"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:34.085213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-c5cc47e1-62ba-461f-b3b7-edd6d74d4586 req-660b8118-dc02-4770-b4f8-2851142f6b36 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:34.085691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-c5cc47e1-62ba-461f-b3b7-edd6d74d4586 req-660b8118-dc02-4770-b4f8-2851142f6b36 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:34.086141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-c5cc47e1-62ba-461f-b3b7-edd6d74d4586 req-660b8118-dc02-4770-b4f8-2851142f6b36 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:34.097968 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-c5cc47e1-62ba-461f-b3b7-edd6d74d4586 req-660b8118-dc02-4770-b4f8-2851142f6b36 service nova] Creating event network-changed:eb225218-2745-41d3-a1a0-9cca41ac10b3 for instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 on hv-cinder-80403 Sep 07 13:23:34.103188 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-c5cc47e1-62ba-461f-b3b7-edd6d74d4586 req-660b8118-dc02-4770-b4f8-2851142f6b36 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032463 Sep 07 13:23:34.103788 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 357/752] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:34.222419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:34.223233 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:34.230074 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:34.230560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:34.230999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:34.231737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:34.232200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:34.232626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:34.371453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:34.379197 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c70123f8-78f5-409d-9d1c-78dfa77ae13c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1672 microversion: 2.1 time: 0.160896 Sep 07 13:23:34.379778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 396/753] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:34 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:35.408559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:35.409676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:35.421456 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:35.422268 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:35.423045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:35.424241 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:35.425020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:35.425710 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:35.540447 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:35.550321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-27d793e1-98b4-496b-99ee-9d4e6e48171f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1604 microversion: 2.1 time: 0.149735 Sep 07 13:23:35.551796 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 358/754] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:35 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:36.149085 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-9c8d6252-20cc-4c07-9825-777d37018783 req-282c5ed3-88cb-4b02-954d-d85c446f1fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6", "name": "network-vif-deleted", "tag": "3986b26f-25d2-4ffe-9e10-5f1071509fb2"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:36.163581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9c8d6252-20cc-4c07-9825-777d37018783 req-282c5ed3-88cb-4b02-954d-d85c446f1fb4 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:36.164059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9c8d6252-20cc-4c07-9825-777d37018783 req-282c5ed3-88cb-4b02-954d-d85c446f1fb4 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:36.164487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9c8d6252-20cc-4c07-9825-777d37018783 req-282c5ed3-88cb-4b02-954d-d85c446f1fb4 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:36.184343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-9c8d6252-20cc-4c07-9825-777d37018783 req-282c5ed3-88cb-4b02-954d-d85c446f1fb4 service nova] Creating event network-vif-deleted:3986b26f-25d2-4ffe-9e10-5f1071509fb2 for instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 on hv-cinder-80403 Sep 07 13:23:36.192442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-9c8d6252-20cc-4c07-9825-777d37018783 req-282c5ed3-88cb-4b02-954d-d85c446f1fb4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048154 Sep 07 13:23:36.193696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 397/755] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:36.581294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:36.583150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:36.596766 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:36.598263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:36.598976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:36.600628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:36.601255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:36.602057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:36.657098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:36.657868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:36.658559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:36.659516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lazy-loading 'fault' on Instance uuid 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:23:36.712696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:36.727841 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-426b8272-0f79-485b-8f72-047e39c71545 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 200 len: 1327 microversion: 2.1 time: 0.154641 Sep 07 13:23:36.728638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 359/756] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:36 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 1327 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:37.761125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:37.761965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:37.768019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:37.768513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:37.768991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:37.769709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:37.770189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:37.770633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:37.787218 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] HTTP exception thrown: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Request method failure captured: Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 HTTP/1.1 Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJm7utizziep0dDmzTD_0xtfGx1kHX33TQGJCm4pWdFzdyA3WHxiN00L2ymL7-xh5nCorEclZCvX06q-keaeDGRc7l8gceyUIpSIQ8jncOtnR3hoTPYe0kWZwekTHz-sUki96TwEiRGp7Je2o9fZXXGAV-pcKnzJuQl8TJiXx6Gyl-Y Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:23:37.789485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccb52045ffa14e94998e764c1dbc605e"}]}] Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: b55eed583fac43fb9bfe1366a42bd2fc Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:23:37.791084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6'} Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:23:37.791995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:23:37.793419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:23:37.794800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Returning 404 to user: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:23:37.794800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9d104be8-49ca-4cfd-9c15-93d701ffde30 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 404 len: 111 microversion: 2.1 time: 0.034710 Sep 07 13:23:37.794800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 398/757] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:37 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:23:37.800292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cbf2f919-7b6d-400b-af50-05f4dc43c024 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '.version_select at 0x7fa3db6c38b0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:37.823948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cbf2f919-7b6d-400b-af50-05f4dc43c024 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747772173" status: 202 len: 0 microversion: 2.1 time: 0.027403 Sep 07 13:23:37.824539 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 360/758] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Sep 7 13:23:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747772173 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:23:38.557667 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3a9a97ae-a237-4f1f-8a7b-a27dd6a43e2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'create', calling method: .version_select at 0x7fa3def2ec10>, body: {"keypair": {"name": "tempest-keypair-163363899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJhbSVVynTTp4PhqIfuW1qSdTkyHX4sxBWN4DH2/BX5i/7QUunBihwPYix5sFilCezsK04rVxCpJZloeocFEjJZop43L7VQqElj5FNT9YgiBUW+zBgUA9jDq5U+uzdWFA=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:38.578170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-3a9a97ae-a237-4f1f-8a7b-a27dd6a43e2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for project ccb52045ffa14e94998e764c1dbc605e. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:23:38.590263 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-3a9a97ae-a237-4f1f-8a7b-a27dd6a43e2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for user b55eed583fac43fb9bfe1366a42bd2fc and project ccb52045ffa14e94998e764c1dbc605e. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:23:38.618262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3a9a97ae-a237-4f1f-8a7b-a27dd6a43e2c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064867 Sep 07 13:23:38.618891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 399/759] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:23:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:40.050765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1006845989", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf36dea6-842d-4d1e-bd77-9da1f9f07b62"}], "security_groups": [{"name": "tempest-securitygroup--58208922"}], "key_name": "tempest-keypair-163363899", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:40.196084 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] validate_networks() for [('cf36dea6-842d-4d1e-bd77-9da1f9f07b62', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:23:40.389456 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:40.594153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:23:40.594625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:23:40.595038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:23:40.595471 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:23:40.595954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:23:40.607231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:40.607723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:40.608155 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:40.608868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:40.609323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:40.609743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:40.627828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for project ccb52045ffa14e94998e764c1dbc605e. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:23:40.631949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Getting quotas for user b55eed583fac43fb9bfe1366a42bd2fc and project ccb52045ffa14e94998e764c1dbc605e. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:23:40.642795 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:23:40.645098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:23:40.694488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-589916b6-7c11-445c-9c6d-d15258ede008 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.648849 Sep 07 13:23:40.695152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 361/760] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:23:40 2022] POST /compute/v2.1/servers => generated 400 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:23:40.706945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-aeba9888-2153-4a7b-bdf0-027f6a0c5e9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:40.707581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-aeba9888-2153-4a7b-bdf0-027f6a0c5e9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:40.765388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-aeba9888-2153-4a7b-bdf0-027f6a0c5e9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:40.773692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-aeba9888-2153-4a7b-bdf0-027f6a0c5e9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1237 microversion: 2.1 time: 0.071085 Sep 07 13:23:40.774277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 400/761] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:40 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:41.798260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:41.798898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:41.806611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:41.807123 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:41.807580 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:41.808393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:41.808853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:41.809282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:41.872961 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:41.881068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-507665cf-71b2-4e85-b8c9-429315a88834 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1289 microversion: 2.1 time: 0.087993 Sep 07 13:23:41.881657 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 362/762] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:41 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:42.905300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:42.906167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:42.913461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:42.914871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:42.914871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:42.915272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:42.915664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:42.916052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:43.146248 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:43.160381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8927202c-d740-4579-af0b-d3cc72518500 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.259688 Sep 07 13:23:43.161987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 401/763] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:42 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:43.736220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-e346da6a-a0ad-4424-a5a9-5a40c3f2992f req-f7900bb7-2863-4ff6-9f2f-f8802cc61313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308", "tag": "5bd82742-b876-457e-a7e2-01683b424513"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:43.747097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e346da6a-a0ad-4424-a5a9-5a40c3f2992f req-f7900bb7-2863-4ff6-9f2f-f8802cc61313 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:43.747546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e346da6a-a0ad-4424-a5a9-5a40c3f2992f req-f7900bb7-2863-4ff6-9f2f-f8802cc61313 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:43.747984 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e346da6a-a0ad-4424-a5a9-5a40c3f2992f req-f7900bb7-2863-4ff6-9f2f-f8802cc61313 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:43.762360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-e346da6a-a0ad-4424-a5a9-5a40c3f2992f req-f7900bb7-2863-4ff6-9f2f-f8802cc61313 service nova] Creating event network-changed:5bd82742-b876-457e-a7e2-01683b424513 for instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 on hv-cinder-80403 Sep 07 13:23:43.767953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-e346da6a-a0ad-4424-a5a9-5a40c3f2992f req-f7900bb7-2863-4ff6-9f2f-f8802cc61313 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036824 Sep 07 13:23:43.768880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 363/764] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:23:44.186945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:44.187858 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:44.190259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:44.196819 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:44.197510 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:44.197933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:44.198645 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:44.199094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:44.199537 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:44.405501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:44.413598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fb8b28fe-3f0a-4e47-904e-917fe18df317 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.232577 Sep 07 13:23:44.414189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 402/765] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:44 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:45.438327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:45.439058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:45.445456 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:45.445948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:45.446415 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:45.447148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:45.447618 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:45.448046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:45.615887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:45.624031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cd5068d5-845e-4da1-9205-48ceaf88aae6 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.190536 Sep 07 13:23:45.624709 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 364/766] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:45 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:46.647716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:46.648542 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:46.656454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:46.657357 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:46.660443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:46.660443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:46.660443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:46.660443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:46.808889 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:46.818921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-735bf443-1fa4-45b1-aadc-87dc687c7828 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.175594 Sep 07 13:23:46.819576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 403/767] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:46 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:47.842644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:47.843277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:47.850156 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:47.850595 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:47.851083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:47.851819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:47.852538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:47.852966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:48.023349 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:48.032245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-13b27de8-a3b0-4fb9-959f-1c2454400c46 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.193397 Sep 07 13:23:48.032753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 365/768] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:47 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:49.056657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:49.057369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:49.065015 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:49.065592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:49.066149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:49.066759 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:49.067687 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:49.068710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:49.213251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:49.221225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-20685e7b-3bee-4e8b-b172-766572cab6ec tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.169108 Sep 07 13:23:49.221817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 404/769] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:49 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:50.088246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-b035c0a3-8a19-426a-a638-7500dacfc019 req-c4238650-f3b8-4bae-8eff-327db9432715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308", "name": "network-vif-plugged", "status": "completed", "tag": "5bd82742-b876-457e-a7e2-01683b424513"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:50.099496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b035c0a3-8a19-426a-a638-7500dacfc019 req-c4238650-f3b8-4bae-8eff-327db9432715 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:50.100594 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b035c0a3-8a19-426a-a638-7500dacfc019 req-c4238650-f3b8-4bae-8eff-327db9432715 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:50.101049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b035c0a3-8a19-426a-a638-7500dacfc019 req-c4238650-f3b8-4bae-8eff-327db9432715 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:50.113943 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-b035c0a3-8a19-426a-a638-7500dacfc019 req-c4238650-f3b8-4bae-8eff-327db9432715 service nova] Creating event network-vif-plugged:5bd82742-b876-457e-a7e2-01683b424513 for instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 on hv-cinder-80403 Sep 07 13:23:50.119889 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-b035c0a3-8a19-426a-a638-7500dacfc019 req-c4238650-f3b8-4bae-8eff-327db9432715 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035594 Sep 07 13:23:50.120511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 366/770] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:50.245138 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:50.245737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:50.257047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:50.257934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:50.258731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:50.260016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:50.260880 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:50.261597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:50.479285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:50.488170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-056d6b00-e0f1-4787-8f26-b6d8f7567971 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.247072 Sep 07 13:23:50.488765 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 405/771] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:50 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:51.512606 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:51.513500 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:51.518784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:51.519733 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:51.527460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.527966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.528621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.529345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.529810 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.530240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.676001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:51.687238 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0439b1f6-a552-467b-aa86-3e48ee8b3018 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1361 microversion: 2.1 time: 0.175396 Sep 07 13:23:51.687920 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 367/772] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:51 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:52.712159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:52.712740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:52.714503 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=6 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:52.720258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.720748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.721183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.721887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.722339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.722762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.870274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:52.878464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-910a5b36-ead0-48bf-95b1-adb909a7391d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1546 microversion: 2.1 time: 0.170677 Sep 07 13:23:52.879047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 406/773] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:52 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:52.901767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:52.902384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:52.908845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.909369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.909906 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.910580 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.911025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.911533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.003386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fde34f9b-bbf0-4def-96b1-272416d243fe tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105339 Sep 07 13:23:53.003951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 368/774] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:23:52 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:23:54.392817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-c9abeed3-f77f-4d9f-9635-5486e780cbb1 req-be963199-992a-4a66-ba4b-59e14495ddf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308", "tag": "5bd82742-b876-457e-a7e2-01683b424513"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:54.405528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-c9abeed3-f77f-4d9f-9635-5486e780cbb1 req-be963199-992a-4a66-ba4b-59e14495ddf5 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.406231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-c9abeed3-f77f-4d9f-9635-5486e780cbb1 req-be963199-992a-4a66-ba4b-59e14495ddf5 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.406730 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-c9abeed3-f77f-4d9f-9635-5486e780cbb1 req-be963199-992a-4a66-ba4b-59e14495ddf5 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.426264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-c9abeed3-f77f-4d9f-9635-5486e780cbb1 req-be963199-992a-4a66-ba4b-59e14495ddf5 service nova] Creating event network-changed:5bd82742-b876-457e-a7e2-01683b424513 for instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 on hv-cinder-80403 Sep 07 13:23:54.432115 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-c9abeed3-f77f-4d9f-9635-5486e780cbb1 req-be963199-992a-4a66-ba4b-59e14495ddf5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052425 Sep 07 13:23:54.432844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 407/775] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:55.449821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:55.450662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:55.458856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.459512 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.460101 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:55.460940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.461588 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.462143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:55.491130 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6a372f62-5e8b-49dd-87c1-043492b07812 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/ips" status: 200 len: 150 microversion: 2.20 time: 0.045549 Sep 07 13:23:55.491732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 369/776] 10.222.0.61 () {60 vars in 1289 bytes} [Wed Sep 7 13:23:55 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:23:57.906592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:57.907486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:57.915477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:57.916019 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:57.916453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:57.917164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:57.917617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:57.918110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:57.942970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lazy-loading 'flavor' on Instance uuid 38430858-246f-449d-9580-9747b3bf22e0 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:23:58.166732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-19fdb4bc-90b9-471b-aeae-7145616bffc4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/action" status: 202 len: 0 microversion: 2.20 time: 0.265534 Sep 07 13:23:58.167303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 408/777] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Sep 7 13:23:57 2022] POST /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:23:58.176112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:58.176848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:58.183698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.184325 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.184685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.185406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.185865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.186296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.331439 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:58.340090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:58.341537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:58.342861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-13c60dd3-2c5e-46d4-8c11-9860db988817 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.170651 Sep 07 13:23:58.343280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 370/778] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:58 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:59.369316 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.370237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:59.376972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.377454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.377887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.378581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.379027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.379484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.519263 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:59.528248 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:59.529720 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:59.530897 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e564438a-5047-42ee-a902-727fdb5434b1 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.167031 Sep 07 13:23:59.531487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 409/779] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:59 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:00.557559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:00.558168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:00.565060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:00.565553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:00.565992 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:00.566696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:00.567177 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:00.567606 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:00.570328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:00.713483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:00.723053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:00.724685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:00.726502 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-46d80a5b-51a6-4ac9-99b3-5bf09a323ba9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.173486 Sep 07 13:24:00.727061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 371/780] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:00 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:01.753884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:01.754436 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:01.761663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.762137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.762574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.763295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.763751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.764169 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.766876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:01.911455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.920552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.921475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.922747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-91c00361-f977-4399-9084-80a089f8ea43 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.173199 Sep 07 13:24:01.923352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 410/781] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:01 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:02.948184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:02.948948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:02.955605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.956095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.956534 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.957641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.957641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.960370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.113393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.122805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.124310 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.125488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b8d6f9fa-d4e9-426d-b832-8d6b991f958e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.181754 Sep 07 13:24:03.126054 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 372/782] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:02 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:04.152356 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:04.152967 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:04.159262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.159768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.160260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.161093 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.161545 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.161966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.317856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:04.326985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:04.328512 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:04.329685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4634f296-4077-4a30-a5ab-c41c173cacae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.181289 Sep 07 13:24:04.330260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 411/783] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:04 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:05.360256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:05.361141 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:05.370048 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.370048 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.370048 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:05.370645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.370913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.371339 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:05.548760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:05.564713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:05.567743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:05.570010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-afc6075f-20cf-491f-a652-c25ab07cac62 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.216060 Sep 07 13:24:05.571078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 373/784] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:05 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:06.598057 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:06.598704 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:06.606445 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:06.606947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:06.607416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:06.608179 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:06.608757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:06.609230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:06.786642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:06.800058 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:06.801520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:06.802706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ef0afdf7-c8f2-46db-bd4f-4af753576c17 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.208724 Sep 07 13:24:06.804025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 412/785] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:06 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:07.835282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:07.836252 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:07.844346 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.845035 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.845601 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.846543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.847078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.847774 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.019247 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:08.030111 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:08.032470 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:08.034621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-304327bb-f319-416d-add0-48b40fb3a8a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.207590 Sep 07 13:24:08.035777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 374/786] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:07 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:09.079342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:09.080144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:09.087815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.088302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.088743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.089469 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.090773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.091081 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.284180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:09.293016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:09.294506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:09.295756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4db5b0b6-c5b6-4ba6-854a-73e0f5a2652d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.223406 Sep 07 13:24:09.296332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 413/787] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:09 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:10.322966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:10.323769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:10.331238 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.331735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.332376 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.333108 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.333561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.333989 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.479335 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:10.488698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:10.490161 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:10.491397 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5083348f-da67-4866-a108-25b722861d3c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.173111 Sep 07 13:24:10.491970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 375/788] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:10 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:11.517980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:11.518832 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:11.526404 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:11.526896 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:11.527375 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:11.528093 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:11.528553 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:11.528988 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:11.678886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:11.688052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:11.689683 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:11.691011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4c0c56fa-d9f9-4664-8b4c-36e7f5ba50e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.176956 Sep 07 13:24:11.691756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 414/789] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:11 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:12.716648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:12.717269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:12.719343 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:12.725794 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:12.726284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:12.726983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:12.727459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:12.728175 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:12.728596 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:12.892898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:12.901994 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:12.903495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:12.904673 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-29cbaa04-a97c-47e3-b36d-342e3a23ed07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.191941 Sep 07 13:24:12.905233 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 376/790] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:12 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:13.931530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:13.932139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:13.938536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.939016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.939489 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:13.940180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.940639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.941062 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:14.081460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:14.092099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:14.093944 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:14.095442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6ec9eee8-5fc5-4a23-a7d9-6b28eb9e8233 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.168249 Sep 07 13:24:14.096437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 415/791] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:13 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:15.122541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:15.123199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:15.130103 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.130592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.131063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.131913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.132375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.132793 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.283397 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:15.292916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:15.294474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:15.295752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-84c1d089-fd23-4a0e-9c79-92739036fc2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.177161 Sep 07 13:24:15.296331 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 377/792] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:15 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:16.325564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:16.326128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:16.328635 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=28 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:16.333463 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.333997 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.334443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.335162 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.335615 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.336039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.468025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:16.477120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:16.478826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:16.480049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-72c2bedd-91f8-4f31-8caa-6fc88a675324 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.158664 Sep 07 13:24:16.480617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 416/793] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:16 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:17.522194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:17.522850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:17.529644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:17.530138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:17.530579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:17.531311 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:17.531769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:17.532199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:17.681777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:17.693762 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:17.695755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:17.696929 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fde156b1-ef47-44f4-8607-0b3a71164a02 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.178670 Sep 07 13:24:17.697500 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 378/794] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:17 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:18.725884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:18.726541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:18.733650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:18.734137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:18.734575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:18.735305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:18.735763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:18.736191 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:18.868627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:18.877038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:18.878567 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:18.879764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7eb9df88-b957-40fc-9fc2-d74e5b32efb4 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.157781 Sep 07 13:24:18.880335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 417/795] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:18 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:19.497698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:19.498476 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:19.505413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.505906 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.506336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.507133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.507610 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.508028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.603691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lazy-loading 'services' on Instance uuid 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:19.684021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f0c2f531-3ef2-4125-bafd-b83f5757cba3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments/0232c02a-655a-41e5-844b-1823a9ef6566" status: 202 len: 0 microversion: 2.1 time: 0.189891 Sep 07 13:24:19.684512 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 379/796] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:24:19 2022] DELETE /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments/0232c02a-655a-41e5-844b-1823a9ef6566 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:24:19.693200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:19.695531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:19.701942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.702443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.702912 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.703760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.704475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.704913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.741590 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-951e88bc-50c4-4f22-84d6-ec167145dfbc tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052433 Sep 07 13:24:19.742371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 418/797] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:24:19 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:19.906951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:19.907686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:19.914539 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.915029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.915492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.916217 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.916672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.917099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.056567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:20.065062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:20.066518 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:20.067723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9ef2f12f-840c-4633-a182-7299d9945155 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.165386 Sep 07 13:24:20.068282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 380/798] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:19 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:20.754344 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:20.756816 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:20.764021 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:20.764649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:20.765202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.765998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:20.766451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:20.766877 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.797930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a723bcce-8995-461d-877e-22118e39d278 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047642 Sep 07 13:24:20.798509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 419/799] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:24:20 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:21.097909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:21.098518 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:21.106197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.106692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.107163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.107879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.108330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.108758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.251434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:21.259904 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:21.261373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:21.262527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b5c204b0-8f61-4c72-99ca-5f8f9f14693a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.168773 Sep 07 13:24:21.263091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 381/800] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:21 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:21.810534 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:21.812758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:21.819476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.820468 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.820905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.821607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.822058 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.822474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.853576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-465f2b04-dcf1-42d5-979e-a04d8b321f63 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046742 Sep 07 13:24:21.854446 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 420/801] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:24:21 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:24:21.940587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:21.941080 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:21.947686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.948173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.948611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.949302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.949765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.950194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.976615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:22.056687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fe07a863-177e-495b-b274-a9e1e0fd443b tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 204 len: 0 microversion: 2.1 time: 0.119686 Sep 07 13:24:22.057399 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 382/802] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:21 2022] DELETE /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:22.066363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:22.066888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:22.074456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:22.074941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:22.075477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:22.076261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:22.076714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:22.077138 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:22.209838 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:22.217800 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e2dfda8f-e826-4748-ae10-c716ff26cae4 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1688 microversion: 2.1 time: 0.156042 Sep 07 13:24:22.218372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 421/803] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:22 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:22.291326 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:22.292275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:22.298873 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:22.299392 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:22.299828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:22.300521 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:22.300972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:22.301394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:22.435333 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:22.443611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:22.445064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:22.446228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bbf4fbe4-2e1f-466d-88a3-78820cb805c9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.159763 Sep 07 13:24:22.446785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 383/804] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:22 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:23.240073 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:23.240677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:23.247197 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.247685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.248122 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.248811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.249312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.249733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.381164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:23.389506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-68446996-5734-4285-9538-f0f7b2f1159a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1688 microversion: 2.1 time: 0.153318 Sep 07 13:24:23.390079 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 422/805] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:23 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:23.471653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:23.472256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:23.478959 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.479873 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.480022 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.480587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.481042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.481462 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.613252 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:23.621884 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:23.623359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:23.624508 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a808a7f4-7117-4ce7-bf8a-5994c38408e5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.156945 Sep 07 13:24:23.625066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 384/806] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:23 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:24.412629 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:24.413410 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:24.421207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:24.421732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:24.422129 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:24.422830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:24.423310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:24.423731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:24.555413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:24.565358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f10dfd2f-4e44-46a6-a4a0-c69a8f937851 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1688 microversion: 2.1 time: 0.156622 Sep 07 13:24:24.565932 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 423/807] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:24 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:24.650613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:24.651231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:24.657732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:24.658164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:24.658600 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:24.659332 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:24.659791 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:24.660217 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:24.675193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:24.794528 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:24.802558 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:24.804038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:24.805162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-479815b4-e70e-4fb0-bb9f-03de911b3544 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.159207 Sep 07 13:24:24.805711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 385/808] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:24 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:25.588932 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:25.589748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:25.596351 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.596840 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.597278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.597983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.598443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.598871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.738488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:25.747052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5f51f717-41e2-427f-a897-a9caa5824918 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1688 microversion: 2.1 time: 0.162029 Sep 07 13:24:25.747677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 424/809] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:25 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:25.787362 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:25.787964 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:25.795604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.796104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.796542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.797264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.797719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.798145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.827238 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:25.831170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:25.831870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:25.838952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.839471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.839908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.840627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.842096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.842096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.922493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-61eacd8d-65fe-4e76-98d6-660ec0f372a5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "DELETE /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 204 len: 0 microversion: 2.1 time: 0.138833 Sep 07 13:24:25.923160 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 386/810] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:25 2022] DELETE /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:25.931952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:25.932661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:25.938844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.939377 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.939806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.940621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.940958 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.941387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:26.000502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:26.009396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:26.010857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:26.012260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-59eaf303-6d07-47e4-92c8-6346d3c15302 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.184933 Sep 07 13:24:26.012694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 425/811] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:25 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:26.093674 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:26.101526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7acc7fb0-27ba-435b-b9a6-b7df8c53515f tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1576 microversion: 2.1 time: 0.173834 Sep 07 13:24:26.102091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 387/812] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:25 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:26.770292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:26.770932 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:26.780147 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:26.780953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:26.781726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:26.782995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:26.783473 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:26.783903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:26.925172 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:26.927396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:26.935393 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-22ea1927-2d93-4bb3-90e4-680f0f2fa9f7 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1688 microversion: 2.1 time: 0.168853 Sep 07 13:24:26.935985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 426/813] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:26 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:27.042584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:27.043364 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:27.049734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:27.050218 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:27.050650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:27.051367 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:27.051822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:27.052244 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:27.126869 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:27.127523 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:27.133374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:27.133864 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:27.134306 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:27.135306 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:27.135773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:27.136207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:27.219413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:27.228842 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:27.230361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:27.231546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-df6879fb-36be-4c7d-8c8d-f7b0e29df5a9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.193399 Sep 07 13:24:27.232108 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 388/814] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:27 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:27.282956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:27.291396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-069b25eb-7c2f-4483-a6ff-62df0ffba8e0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1576 microversion: 2.1 time: 0.169000 Sep 07 13:24:27.298003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 427/815] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:27 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:27.958571 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:27.959226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:27.965787 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:27.966318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:27.966746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:27.967488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:27.967945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:27.968363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.109183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:28.122823 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0ea90b1d-97c1-4685-bff2-fa2e9e02694e tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1688 microversion: 2.1 time: 0.168136 Sep 07 13:24:28.123457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 389/816] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:27 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:28.256559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:28.257080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:28.264277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.264754 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.265182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.265877 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.266326 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.266743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.313891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:28.314609 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:28.320747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.321244 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.321685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.322392 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.323370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.323370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.454805 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:28.462999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:28.464483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:28.465651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-92d2a7e3-6eb3-4975-96af-640ca505063e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.213086 Sep 07 13:24:28.466203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 428/817] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:28 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:28.489413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:28.497820 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-27811377-7d74-409c-ac53-fc795c14ae01 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1576 microversion: 2.1 time: 0.187771 Sep 07 13:24:28.498384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 390/818] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:28 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:29.145834 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:29.146448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:29.157882 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:29.158377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:29.158820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:29.159558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:29.160017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:29.160446 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:29.293104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:29.300881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3d3f01d1-c399-46f7-8804-76cb50f736ad tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1688 microversion: 2.1 time: 0.158947 Sep 07 13:24:29.301452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 429/819] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:29 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:29.493854 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:29.494460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:29.506617 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:29.507182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:29.508340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:29.509240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:29.509764 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:29.510197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:29.521916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:29.522493 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:29.529383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:29.529876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:29.530910 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:29.531707 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:29.532113 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:29.532542 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:29.737607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:29.742450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:29.746520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:29.748008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:29.749167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-913bd3de-8dc4-4db8-ae23-23854be1c1a7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1742 microversion: 2.20 time: 0.259798 Sep 07 13:24:29.749731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 391/820] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:29 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1742 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:29.750483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b89027ed-8bb6-456a-81cb-6c0486d6c829 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1576 microversion: 2.1 time: 0.232600 Sep 07 13:24:29.751209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 430/821] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:29 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:30.326746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:30.327786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:30.340981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:30.342879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:30.344588 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:30.345578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:30.346286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:30.346944 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:30.444829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:30.457967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b7403960-cbd7-4a39-b34c-f315700c1d2a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1621 microversion: 2.1 time: 0.136559 Sep 07 13:24:30.459197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 392/822] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:30 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1621 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:30.652682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-10d0e635-a02d-4932-b0a7-30b3ec8cf853 req-4f80ad4e-185f-4cc4-8e02-277c0a8a4e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f47c9c-3c45-4ab9-aa2d-64f2e2683733", "name": "network-vif-deleted", "tag": "eb225218-2745-41d3-a1a0-9cca41ac10b3"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:30.664511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-10d0e635-a02d-4932-b0a7-30b3ec8cf853 req-4f80ad4e-185f-4cc4-8e02-277c0a8a4e26 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:30.665287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-10d0e635-a02d-4932-b0a7-30b3ec8cf853 req-4f80ad4e-185f-4cc4-8e02-277c0a8a4e26 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:30.665886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-10d0e635-a02d-4932-b0a7-30b3ec8cf853 req-4f80ad4e-185f-4cc4-8e02-277c0a8a4e26 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:30.678377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-10d0e635-a02d-4932-b0a7-30b3ec8cf853 req-4f80ad4e-185f-4cc4-8e02-277c0a8a4e26 service nova] Creating event network-vif-deleted:eb225218-2745-41d3-a1a0-9cca41ac10b3 for instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 on hv-cinder-80403 Sep 07 13:24:30.687039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-10d0e635-a02d-4932-b0a7-30b3ec8cf853 req-4f80ad4e-185f-4cc4-8e02-277c0a8a4e26 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037119 Sep 07 13:24:30.693332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 431/823] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:30.778637 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:30.781126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:30.782514 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:30.782926 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:30.791412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:30.803446 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:30.804302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:30.804947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:30.806575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:30.807302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:30.808383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:30.810099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:30.813422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:30.813741 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:30.814272 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:30.815465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:31.301194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:31.310732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f05d3e5b-5288-4a8e-90c3-8d91524f95d2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1508 microversion: 2.1 time: 0.540694 Sep 07 13:24:31.311822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 393/824] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:30 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:31.438770 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:31.451614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:31.457177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:31.458549 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9c3572fb-28fa-48e6-ac05-364e5fddbd66 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1742 microversion: 2.20 time: 0.686813 Sep 07 13:24:31.461653 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 432/825] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:30 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1742 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:31.484079 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:31.484697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:31.491515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:31.492870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:31.493523 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:31.494458 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:31.495136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:31.495576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:31.554223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:31.554711 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:31.555198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:31.555678 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lazy-loading 'fault' on Instance uuid 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:31.645233 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-0b26dc90-b4ef-4f4f-8b09-932b2ce77ba8 req-d2cfea8f-f997-4da8-a872-4d1f34f399b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73983bde-1a9b-4a8b-aa02-2481c6e1d727", "name": "network-vif-deleted", "tag": "56ce5a2d-ff39-49c0-ae86-ca2c874d86a1"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:31.647589 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:31.662841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d9dbbc57-9ed3-48df-a541-e44ff5a5773a tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 200 len: 1335 microversion: 2.1 time: 0.182919 Sep 07 13:24:31.665347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 433/826] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:31 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 1335 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:31.672209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-0b26dc90-b4ef-4f4f-8b09-932b2ce77ba8 req-d2cfea8f-f997-4da8-a872-4d1f34f399b8 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:31.673038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-0b26dc90-b4ef-4f4f-8b09-932b2ce77ba8 req-d2cfea8f-f997-4da8-a872-4d1f34f399b8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:31.673723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-0b26dc90-b4ef-4f4f-8b09-932b2ce77ba8 req-d2cfea8f-f997-4da8-a872-4d1f34f399b8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:31.709806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-0b26dc90-b4ef-4f4f-8b09-932b2ce77ba8 req-d2cfea8f-f997-4da8-a872-4d1f34f399b8 service nova] Creating event network-vif-deleted:56ce5a2d-ff39-49c0-ae86-ca2c874d86a1 for instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 on hv-cinder-80403 Sep 07 13:24:31.715618 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-0b26dc90-b4ef-4f4f-8b09-932b2ce77ba8 req-d2cfea8f-f997-4da8-a872-4d1f34f399b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246267 Sep 07 13:24:31.716692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 394/827] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:32.337202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:32.337975 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:32.345517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.346242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.346908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.347836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.348536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.348974 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.388188 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.388680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.389118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.389572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lazy-loading 'fault' on Instance uuid 73983bde-1a9b-4a8b-aa02-2481c6e1d727 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:32.441292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:32.451904 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5be6546c-2084-4ab7-8a38-3a501003ec62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 200 len: 1230 microversion: 2.1 time: 0.119853 Sep 07 13:24:32.452984 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 434/828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:32 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 1230 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:32.487166 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:32.487934 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:32.495637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.496213 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.496719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.497636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.498091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.498518 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.655718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:32.666242 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:32.667614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:32.669571 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e665e609-fa7e-4e0c-acde-492f33712429 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1742 microversion: 2.20 time: 0.187267 Sep 07 13:24:32.670119 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 395/829] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:32 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:32.680600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-7c6b3e20-1f39-444b-af5e-265aa7eacf3d req-9da9b0d8-cf8c-479c-b1d9-506d0b861839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38430858-246f-449d-9580-9747b3bf22e0", "name": "network-vif-plugged", "status": "completed", "tag": "d25ce013-3fdb-4ed2-9267-0c86e2ba62b0"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:32.691025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7c6b3e20-1f39-444b-af5e-265aa7eacf3d req-9da9b0d8-cf8c-479c-b1d9-506d0b861839 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.691893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7c6b3e20-1f39-444b-af5e-265aa7eacf3d req-9da9b0d8-cf8c-479c-b1d9-506d0b861839 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.692529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7c6b3e20-1f39-444b-af5e-265aa7eacf3d req-9da9b0d8-cf8c-479c-b1d9-506d0b861839 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.709076 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:32.709321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-7c6b3e20-1f39-444b-af5e-265aa7eacf3d req-9da9b0d8-cf8c-479c-b1d9-506d0b861839 service nova] Creating event network-vif-plugged:d25ce013-3fdb-4ed2-9267-0c86e2ba62b0 for instance 38430858-246f-449d-9580-9747b3bf22e0 on hv-cinder-80403 Sep 07 13:24:32.710552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 35f47c9c-3c45-4ab9-aa2d-64f2e2683733] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:32.714595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-7c6b3e20-1f39-444b-af5e-265aa7eacf3d req-9da9b0d8-cf8c-479c-b1d9-506d0b861839 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038215 Sep 07 13:24:32.715546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 435/830] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:32.720903 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.721408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.721851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.722567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:32.723070 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:32.723595 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:32.740592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] HTTP exception thrown: Instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 could not be found. Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Request method failure captured: Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 HTTP/1.1 Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm9eG3_FMKXY1fuUDokLMDxyDGowmvWbRnBlDdK22BwYh_6f_RELkSFM_FEGruAPKOTcGsxWHjI1mRJLoSQUuYe0vx-o8Ip1ws_SFZ9sH7CWvxVujnebCdulx5GeYf7zVZCt0zsVTBUlwMW8bL9UhKgSFefwcDauQbpcaNypmf4rYU Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:24:32.742990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d2ca3f0240b478e8463f74032a1b575"}]}] Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 406bdf61f9284ebc8620b21ee414ec91 Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 could not be found. Sep 07 13:24:32.744371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '35f47c9c-3c45-4ab9-aa2d-64f2e2683733'} Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 could not be found. Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:32.745273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 could not be found. Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 could not be found. Sep 07 13:24:32.746531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:32.748065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Returning 404 to user: Instance 35f47c9c-3c45-4ab9-aa2d-64f2e2683733 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:32.748065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-54862802-7ae9-4f0d-9489-d496fa428462 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733" status: 404 len: 111 microversion: 2.1 time: 0.041696 Sep 07 13:24:32.748065 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 396/831] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:32 2022] GET /compute/v2.1/servers/35f47c9c-3c45-4ab9-aa2d-64f2e2683733 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:32.759575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fd3e4369-a70b-47de-a18c-28721c82d8be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '.version_select at 0x7fa3db6f5af0>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:32.784141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fd3e4369-a70b-47de-a18c-28721c82d8be tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076232612" status: 202 len: 0 microversion: 2.1 time: 0.030811 Sep 07 13:24:32.784730 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 436/832] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Sep 7 13:24:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076232612 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:24:33.475688 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:33.476383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:33.482926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:33.483469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:33.483911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:33.484607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:33.485185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:33.485616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:33.502305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] HTTP exception thrown: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Request method failure captured: Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 HTTP/1.1 Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJpcXqNafs-kQSI089kET4Vk7fHWgGQOKvvmoYAn4zHPWqxgmZvOF__NCenUS6SNk2sBN_G7ciF2-YZui6EG-Ho5sejlneFrSPxMw2gXBfX9PVkpRG2jDrQvR-WPnMCYGIRcO1IYhwgFozas0sx6etujbi11rxhBb4sv5dUhAKAUCD0 Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:24:33.503893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/963b95435fe545bb9e9ff7a1c4490a05"}]}] Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-TestVolumeBootPattern-26226311 Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 57896ea1ff2046d282fe47e2a8191676 Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:24:33.505495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '73983bde-1a9b-4a8b-aa02-2481c6e1d727'} Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:33.506411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:24:33.508670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:33.510814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Returning 404 to user: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:33.510814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-11c9d923-20bd-4aa4-a378-326d789a20e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 404 len: 111 microversion: 2.1 time: 0.033638 Sep 07 13:24:33.517195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 397/833] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:33 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:33.620649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1229067791", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-524724481", "security_groups": [{"name": "tempest-secgroup-smoke-1156289928"}], "block_device_mapping_v2": [{"uuid": "bf76f3f5-8368-4559-9c1f-720c7312d6cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "162da744-90cb-4ad5-9d57-0be2d76a9630"}]}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:33.696651 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:33.697254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:33.706903 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:33.707755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:33.708185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:33.709240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:33.709863 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:33.710466 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:33.748601 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] validate_networks() for [('162da744-90cb-4ad5-9d57-0be2d76a9630', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:24:33.945508 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:33.955247 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:33.956817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:33.958077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b18be074-0274-46e7-ae12-96544de737c0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.265520 Sep 07 13:24:33.958643 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 398/834] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:33 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:34.320315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:24:34.320767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:24:34.321239 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:24:34.321649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:24:34.322056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:24:34.331195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:34.331753 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:34.332308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:34.333027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:34.333478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:34.333901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:34.352761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:24:34.357108 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for user 57896ea1ff2046d282fe47e2a8191676 and project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:24:34.421335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:24:34.423732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf76f3f5-8368-4559-9c1f-720c7312d6cd',volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:24:34.645290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3d31dcd2-7179-4a80-bef2-73237a29188c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.028935 Sep 07 13:24:34.658096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 437/835] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:24:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:24:34.663710 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-797969f2-b345-4510-ae10-959d726eec38 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:34.664853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-797969f2-b345-4510-ae10-959d726eec38 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:34.772178 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-797969f2-b345-4510-ae10-959d726eec38 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:34.780801 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-797969f2-b345-4510-ae10-959d726eec38 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1094 microversion: 2.1 time: 0.120965 Sep 07 13:24:34.781791 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 399/836] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:34 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:34.986871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:34.987607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:34.999574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.004922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.005618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.006612 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.007857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.008526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.204475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:35.213840 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:35.216187 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:35.217721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8f5dd695-38bc-4cd6-9353-b71f70ed391e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.235549 Sep 07 13:24:35.218298 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 438/837] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:34 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:35.822747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:35.823393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:35.833323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.833822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.834256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.835029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.835566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.835992 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.851522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:35.852308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:35.867709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.868561 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.869008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.869715 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.870170 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.870599 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.901001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:35.908538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:35.916895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-921c8a8e-5d95-4cdb-8414-79de12af5933 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1192 microversion: 2.1 time: 0.097981 Sep 07 13:24:35.917679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 400/838] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:35 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:36.013980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ff6466b7-3a46-49fa-a94f-d2ce3dcdd9f0 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 204 len: 0 microversion: 2.1 time: 0.166390 Sep 07 13:24:36.016033 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 439/839] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:35 2022] DELETE /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:36.025100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:36.026039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:36.033015 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.033508 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.034095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:36.034995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.035809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.036408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:36.220371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:36.230059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-220e6294-e1d4-4b10-9ba3-d3388ced87ce tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1507 microversion: 2.1 time: 0.209105 Sep 07 13:24:36.243871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 401/840] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:36 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:36.253034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:36.256630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:36.267597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.269066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.270130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:36.271495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.272342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.273610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:36.447736 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:36.458398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:36.461435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:36.462684 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-648f9600-cada-4597-ad00-c91aa8cd45da tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.214758 Sep 07 13:24:36.463284 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 440/841] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:36 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:36.941544 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:36.942891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:36.967547 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.968490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.969163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:36.970125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.970815 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.971506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:37.145173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:37.174706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2344b991-2aec-4632-b238-afb34bc30a24 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1210 microversion: 2.1 time: 0.236796 Sep 07 13:24:37.174706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 402/842] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:36 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1210 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:37.267864 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:37.268757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:37.283657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:37.292830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:37.293620 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:37.294706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:37.347558 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:37.348082 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:37.499960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:37.503248 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:37.541871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:37.544916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:37.545508 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:37.549009 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:37.549620 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:37.555370 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:37.582484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:37.776976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:37.799872 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-344ecddb-9b15-4b2c-b811-73c38fad8180 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1507 microversion: 2.1 time: 0.535203 Sep 07 13:24:37.801729 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 441/843] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:37 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:37.899889 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:37.916438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:37.920934 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:37.925622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6b87a98a-d7dc-4f2e-b615-c7ddd7845851 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.435281 Sep 07 13:24:37.933394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 403/844] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:37 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:38.200482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:38.201212 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:38.215971 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.216578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.217097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.217948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.218475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.218975 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.282578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-a941510c-c487-49a9-a50a-49c9ab190576 req-0b3cf9c6-b15b-46de-8974-fd67afeabaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4", "name": "network-vif-deleted", "tag": "8f09e61a-18d1-47b4-af0c-2677ce493831"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:38.304228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a941510c-c487-49a9-a50a-49c9ab190576 req-0b3cf9c6-b15b-46de-8974-fd67afeabaa3 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.304976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a941510c-c487-49a9-a50a-49c9ab190576 req-0b3cf9c6-b15b-46de-8974-fd67afeabaa3 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.305593 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a941510c-c487-49a9-a50a-49c9ab190576 req-0b3cf9c6-b15b-46de-8974-fd67afeabaa3 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.329081 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-a941510c-c487-49a9-a50a-49c9ab190576 req-0b3cf9c6-b15b-46de-8974-fd67afeabaa3 service nova] Creating event network-vif-deleted:8f09e61a-18d1-47b4-af0c-2677ce493831 for instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 on hv-cinder-80403 Sep 07 13:24:38.368110 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-a941510c-c487-49a9-a50a-49c9ab190576 req-0b3cf9c6-b15b-46de-8974-fd67afeabaa3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089836 Sep 07 13:24:38.379639 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 404/845] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:38.482208 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:38.503046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d284d25c-231b-4a8c-bf03-337e4ad565cd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.306764 Sep 07 13:24:38.530949 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 442/846] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:38 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:38.829363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:38.830365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:38.839317 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.840434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.841076 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.841973 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.842596 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.843248 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.905255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.906181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.906785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.907560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lazy-loading 'fault' on Instance uuid b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:38.962116 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:38.962817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:38.974262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.975158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.975796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.981620 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:38.982456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:38.983126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:39.017866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:39.033594 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d7c39a78-1aeb-4d01-ad90-7705090bee81 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 200 len: 1311 microversion: 2.1 time: 0.208714 Sep 07 13:24:39.034887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 405/847] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:38 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:39.094498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-caa0df8a-efac-4c07-96b3-9ce4998cfd43 req-0e91959a-9081-4b93-92ad-f1c9c8fb6f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a643bbd7-7da9-4fc5-a154-c46f0c2834f3", "tag": "d24831c0-0afc-4520-8128-ae3c95f534e4"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:39.124008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-caa0df8a-efac-4c07-96b3-9ce4998cfd43 req-0e91959a-9081-4b93-92ad-f1c9c8fb6f7f service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:39.124659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-caa0df8a-efac-4c07-96b3-9ce4998cfd43 req-0e91959a-9081-4b93-92ad-f1c9c8fb6f7f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:39.125032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-caa0df8a-efac-4c07-96b3-9ce4998cfd43 req-0e91959a-9081-4b93-92ad-f1c9c8fb6f7f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:39.144399 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-caa0df8a-efac-4c07-96b3-9ce4998cfd43 req-0e91959a-9081-4b93-92ad-f1c9c8fb6f7f service nova] Creating event network-changed:d24831c0-0afc-4520-8128-ae3c95f534e4 for instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 on hv-cinder-80403 Sep 07 13:24:39.150392 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-caa0df8a-efac-4c07-96b3-9ce4998cfd43 req-0e91959a-9081-4b93-92ad-f1c9c8fb6f7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062749 Sep 07 13:24:39.154550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 406/848] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:39.191256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:39.201833 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:39.203818 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:39.205258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a646dff9-47a6-4f23-b75c-5098899bee41 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.247277 Sep 07 13:24:39.206014 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 443/849] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:38 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:39.539417 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:39.540712 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:39.548224 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:39.548979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:39.549734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:39.550650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:39.551561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:39.552174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:39.719960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:39.730864 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b2fb9ac7-d787-4d74-b54a-a46cf55be6da tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.196600 Sep 07 13:24:39.732090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 407/850] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:39 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:40.063231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:40.064383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:40.076884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.077626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.078293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.079302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.080036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.080681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.084687 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:40.100659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] HTTP exception thrown: Instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 could not be found. Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Request method failure captured: Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 HTTP/1.1 Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJm9eG3_FMKXY1fuUDokLMDxyDGowmvWbRnBlDdK22BwYh_6f_RELkSFM_FEGruAPKOTcGsxWHjI1mRJLoSQUuYe0vx-o8Ip1ws_SFZ9sH7CWvxVujnebCdulx5GeYf7zVZCt0zsVTBUlwMW8bL9UhKgSFefwcDauQbpcaNypmf4rYU Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:24:40.103261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d2ca3f0240b478e8463f74032a1b575"}]}] Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 406bdf61f9284ebc8620b21ee414ec91 Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 could not be found. Sep 07 13:24:40.105051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4'} Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 could not be found. Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:40.106152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 could not be found. Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 could not be found. Sep 07 13:24:40.107480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:24:40.113139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Returning 404 to user: Instance b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:40.114342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-30aed9af-a906-41b9-8872-6a5e9f162354 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4" status: 404 len: 111 microversion: 2.1 time: 0.060138 Sep 07 13:24:40.115178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 444/851] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:40 2022] GET /compute/v2.1/servers/b8810f5d-5a56-4a65-b7e9-0a58bdcae8f4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:40.125738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:40.126614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:40.135275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.136256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.137074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.138454 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.139198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.139871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.190696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:40.239210 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:40.243318 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:40.251227 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.254870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.255604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.257087 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.258431 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.259174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.318729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0c33f6d4-5f0f-48e3-8869-442147e16200 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 204 len: 0 microversion: 2.1 time: 0.196913 Sep 07 13:24:40.319967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 408/852] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:40 2022] DELETE /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:40.329858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:40.331214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:40.342313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.343116 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.343572 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.344421 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.344950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.345452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.510939 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:40.523922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:40.525402 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:40.534321 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1e6b52c9-859c-4baa-984d-118919cb9c4a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.294086 Sep 07 13:24:40.535194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 445/853] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:40 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:40.553892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:40.565292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2b02a52a-7dc8-4183-b4d9-8dce77e56e15 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.240389 Sep 07 13:24:40.566128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 409/854] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:40 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:40.764699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:40.765499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:40.771599 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.772082 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.772529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.776211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.777270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.778266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.934374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:40.944327 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-298c5386-e860-46b7-8a9f-99495dd6245e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.187984 Sep 07 13:24:40.944976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 446/855] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:40 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:41.565882 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:41.566706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:41.574666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.575029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.575596 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:41.576477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.576860 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.577316 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:41.595885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:41.596542 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:41.612537 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.613034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.613479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:41.614199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.614680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.615092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:41.865531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:41.875154 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:41.876635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:41.877517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:41.877810 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-900eb841-ab24-4364-b780-bf9837f32002 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.320828 Sep 07 13:24:41.891129 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 410/856] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:41 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:41.907307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-79b1538e-e469-4584-bbe5-f63c8851e923 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.316115 Sep 07 13:24:41.911148 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 447/857] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:41 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:41.967416 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:41.968292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:41.977392 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.977893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.978489 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:41.979483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.980060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.980372 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:42.143554 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:42.157930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7626f9c5-25a6-478a-873d-b279ad59e2e3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.194485 Sep 07 13:24:42.172205 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 411/858] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:41 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:42.910580 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:42.911406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:42.917850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:42.918760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:42.918760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:42.919472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:42.919924 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:42.926779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:42.934085 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:42.934981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:42.937125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:42.943081 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:42.943633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:42.944064 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:42.944846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:42.945397 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:42.945834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:43.188935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:43.191828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:43.201582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:43.201958 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3a847046-cccb-499e-b09f-3f46e7971860 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.271698 Sep 07 13:24:43.203947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:43.205557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1e71836b-663e-45a7-aa91-9840d7557796 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.299248 Sep 07 13:24:43.218269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 412/859] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:42 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:43.220793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 448/860] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:42 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:43.227165 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:43.227165 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:43.230785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:43.232058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:43.232682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:43.233607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:43.234083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:43.234518 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:43.394771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:43.403185 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-93338d06-80f2-469f-901f-518782d9dc65 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.186038 Sep 07 13:24:43.403781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 413/861] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:43 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:44.233319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:44.234666 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:44.236284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:44.237036 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:44.246470 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.247482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.248151 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.248281 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.248772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.249152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.249672 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.250323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.251120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.254193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.254193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.254891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.342941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:44.364999 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=6 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:44.480763 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:44.489500 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:44.491160 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:44.494068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4bfd8efa-45e5-4d17-8d2a-e11c3e0f064b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1737 microversion: 2.20 time: 0.262730 Sep 07 13:24:44.507138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 414/862] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:44 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:44.514224 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:44.514891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:44.522840 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.523559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.524255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.525100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:44.525247 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.525887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.526414 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.537706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-59a7cc84-e47a-4fb7-93f7-d4b5a9bd43e3 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1522 microversion: 2.1 time: 0.311532 Sep 07 13:24:44.539038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 449/863] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:44 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:44.705965 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:44.714487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8107f1e0-0d6c-4c1a-8c39-623c210ec6c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.218161 Sep 07 13:24:44.719147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 415/864] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:44 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:44.828941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-0e3bc109-12fd-44c4-b3d2-b79fa72975e3 req-308bcd17-352e-4d92-b291-a87dcee1afb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e55303d-58ec-44db-a67c-2e9729dc076b", "name": "network-vif-deleted", "tag": "acd78dee-6922-4a5c-ad1c-a064a3ba437b"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:44.838339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0e3bc109-12fd-44c4-b3d2-b79fa72975e3 req-308bcd17-352e-4d92-b291-a87dcee1afb8 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.838811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0e3bc109-12fd-44c4-b3d2-b79fa72975e3 req-308bcd17-352e-4d92-b291-a87dcee1afb8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.839262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0e3bc109-12fd-44c4-b3d2-b79fa72975e3 req-308bcd17-352e-4d92-b291-a87dcee1afb8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.850609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-0e3bc109-12fd-44c4-b3d2-b79fa72975e3 req-308bcd17-352e-4d92-b291-a87dcee1afb8 service nova] Creating event network-vif-deleted:acd78dee-6922-4a5c-ad1c-a064a3ba437b for instance 6e55303d-58ec-44db-a67c-2e9729dc076b on hv-cinder-80403 Sep 07 13:24:44.856995 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-0e3bc109-12fd-44c4-b3d2-b79fa72975e3 req-308bcd17-352e-4d92-b291-a87dcee1afb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Sep 07 13:24:44.857943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 450/865] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:45.521997 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:45.522716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:45.525669 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:45.531628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.532202 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.532709 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.533680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.534140 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.534572 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.565563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:45.565956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:45.573556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.574379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.575626 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.576727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.577198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.577636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.614044 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:45.616846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.617518 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.618150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.618804 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lazy-loading 'fault' on Instance uuid 6e55303d-58ec-44db-a67c-2e9729dc076b {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:45.679591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406bdf61f9284ebc8620b21ee414ec91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2ca3f0240b478e8463f74032a1b575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:45.688595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-974aa647-15c1-4f16-9888-3077ad2d1816 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 200 len: 1311 microversion: 2.1 time: 0.127799 Sep 07 13:24:45.689194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 451/866] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:45 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:45.709263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:45.717915 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:45.719327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:45.720473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1cc30937-2375-49b1-95ad-7b5b84b4858c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1719 microversion: 2.20 time: 0.202662 Sep 07 13:24:45.721027 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 416/867] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:45 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1719 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:45.738843 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:45.739484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:45.745778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.746258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.746697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.747609 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.748064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.748497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.881199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:45.890577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8b276776-0cea-4238-b2ff-0c09b52ef0c9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.155635 Sep 07 13:24:45.891185 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 452/868] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:45 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:46.712639 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:46.713172 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] [instance: 6e55303d-58ec-44db-a67c-2e9729dc076b] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:46.719786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.720267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.720704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.721390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.721842 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.722265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.736433 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] HTTP exception thrown: Instance 6e55303d-58ec-44db-a67c-2e9729dc076b could not be found. Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Request method failure captured: Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b HTTP/1.1 Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm9eG3_FMKXY1fuUDokLMDxyDGowmvWbRnBlDdK22BwYh_6f_RELkSFM_FEGruAPKOTcGsxWHjI1mRJLoSQUuYe0vx-o8Ip1ws_SFZ9sH7CWvxVujnebCdulx5GeYf7zVZCt0zsVTBUlwMW8bL9UhKgSFefwcDauQbpcaNypmf4rYU Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:24:46.738059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d2ca3f0240b478e8463f74032a1b575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d2ca3f0240b478e8463f74032a1b575"}]}] Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 2d2ca3f0240b478e8463f74032a1b575 Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1653586121 Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 406bdf61f9284ebc8620b21ee414ec91 Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1653586121-project Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 6e55303d-58ec-44db-a67c-2e9729dc076b could not be found. Sep 07 13:24:46.739641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '6e55303d-58ec-44db-a67c-2e9729dc076b'} Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e55303d-58ec-44db-a67c-2e9729dc076b could not be found. Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:46.741287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e55303d-58ec-44db-a67c-2e9729dc076b could not be found. Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e55303d-58ec-44db-a67c-2e9729dc076b could not be found. Sep 07 13:24:46.742724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:24:46.744051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] Returning 404 to user: Instance 6e55303d-58ec-44db-a67c-2e9729dc076b could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:46.744051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3013a5d9-21d2-47dd-ba32-d2969f40f580 tempest-ServerRescueNegativeTestJSON-1653586121 tempest-ServerRescueNegativeTestJSON-1653586121-project] 10.222.0.61 "GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b" status: 404 len: 111 microversion: 2.1 time: 0.031290 Sep 07 13:24:46.744051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 417/869] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:46 2022] GET /compute/v2.1/servers/6e55303d-58ec-44db-a67c-2e9729dc076b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:46.748578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:46.749200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:46.756220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.756727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.757167 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.757871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.758381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.758811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.893008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:46.901778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:46.903268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:46.904451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2a3accc6-6702-4b9e-a51a-e227805b6d2a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1719 microversion: 2.20 time: 0.159806 Sep 07 13:24:46.905025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 453/870] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:46 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:46.914517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:46.915150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:46.921619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.922103 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.922537 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.923272 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.923726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.924147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:47.063043 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:47.075799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-73a2c030-9ec5-44e2-bad4-e087cc646749 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.165559 Sep 07 13:24:47.076384 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 418/871] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:46 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:47.931863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:47.933064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:47.939307 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:47.939803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:47.940245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:47.940981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:47.941874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:47.941874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.085758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:48.096592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:48.098068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:48.099295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-28911b8c-2619-4a2a-9e28-867766c4db07 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1719 microversion: 2.20 time: 0.173180 Sep 07 13:24:48.099447 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:48.100154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 454/872] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:47 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:48.104970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:48.112088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.112950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.113548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.114437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.115252 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.115685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.256203 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:48.264429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8331596e-7eeb-4787-93a9-7cfac764ef3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.169182 Sep 07 13:24:48.265208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 419/873] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:48 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:48.400023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-c13a170f-d0a2-42fb-87eb-53a63513ae58 req-a7ba1ab8-46af-45fd-8972-e1773858678c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38430858-246f-449d-9580-9747b3bf22e0", "name": "network-vif-unplugged", "status": "completed", "tag": "d25ce013-3fdb-4ed2-9267-0c86e2ba62b0"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:48.409737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-c13a170f-d0a2-42fb-87eb-53a63513ae58 req-a7ba1ab8-46af-45fd-8972-e1773858678c service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.410231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-c13a170f-d0a2-42fb-87eb-53a63513ae58 req-a7ba1ab8-46af-45fd-8972-e1773858678c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.410664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-c13a170f-d0a2-42fb-87eb-53a63513ae58 req-a7ba1ab8-46af-45fd-8972-e1773858678c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.425221 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-c13a170f-d0a2-42fb-87eb-53a63513ae58 req-a7ba1ab8-46af-45fd-8972-e1773858678c service nova] Creating event network-vif-unplugged:d25ce013-3fdb-4ed2-9267-0c86e2ba62b0 for instance 38430858-246f-449d-9580-9747b3bf22e0 on hv-cinder-80403 Sep 07 13:24:48.430684 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-c13a170f-d0a2-42fb-87eb-53a63513ae58 req-a7ba1ab8-46af-45fd-8972-e1773858678c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035337 Sep 07 13:24:48.431658 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 455/874] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:49.126013 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:49.126730 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:49.134317 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.135037 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.135731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.136515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.137043 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.137888 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.142386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:49.290441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:49.291214 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:49.295681 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:49.298373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.299144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.299682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.300410 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.300869 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.301392 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.306012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:49.307622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:49.308812 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-631f7493-eff3-4de4-8d7e-93397dd4a963 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1722 microversion: 2.20 time: 0.186939 Sep 07 13:24:49.324085 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 420/875] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:49 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:49.356671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4a1083b-debb-4a37-abec-65503604d43b"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:49.362122 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:49.371932 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.373289 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.373910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.374943 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.375549 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.377044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.715508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:49.726419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-41a7f88d-7e11-44a1-b04a-65c86a3938d6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.441034 Sep 07 13:24:49.727521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 456/876] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:49 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:49.830659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9ac7cdf0-5853-4ad5-997c-033fc2c540bc tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.498547 Sep 07 13:24:49.832236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 421/877] 10.222.0.61 () {62 vars in 1364 bytes} [Wed Sep 7 13:24:49 2022] POST /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-volume_attachments => generated 188 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:24:49.890713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:49.891654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:49.899336 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.900037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.900646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.901533 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.901993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.902421 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.934583 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-00eb0448-7acb-453e-a2bb-807d6ece76da tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/ips" status: 200 len: 145 microversion: 2.1 time: 0.046451 Sep 07 13:24:49.938238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 457/878] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:24:49 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/ips => generated 145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:50.009988 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:50.010485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:50.019059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.019728 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.020168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.020885 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.021328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.021940 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.383642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ed8652e2-f76c-427a-a37d-0c151d2b24dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-volume_attachments/d4a1083b-debb-4a37-abec-65503604d43b" status: 202 len: 0 microversion: 2.20 time: 0.377824 Sep 07 13:24:50.384604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 422/879] 10.222.0.61 () {60 vars in 1457 bytes} [Wed Sep 7 13:24:50 2022] DELETE /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-volume_attachments/d4a1083b-debb-4a37-abec-65503604d43b => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:50.463913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:50.464486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:50.471040 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.471568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.472183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.472777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.473225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.473961 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.505485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121069) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:24:50.573243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e21e3fcc-e044-4949-801d-ae3e3be8034d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "POST /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/action" status: 202 len: 0 microversion: 2.20 time: 0.113629 Sep 07 13:24:50.573772 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 458/880] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Sep 7 13:24:50 2022] POST /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:50.583540 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:50.587584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:50.592293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.592869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.593377 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.594388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.595083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.595745 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.750308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:50.751055 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:50.759822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.761465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.761600 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:50.762420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.763557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.764252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.765026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.801146 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:50.803015 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:50.805035 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-96553250-308a-401b-8553-5e76b7ad9d6c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1670 microversion: 2.20 time: 0.227021 Sep 07 13:24:50.806563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 423/881] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:50 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:50.943049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:50.951685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-eb16fa01-351f-4f49-92cc-585f109a43ee tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.205829 Sep 07 13:24:50.953028 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 459/882] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:50 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:51.421645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3556478-b614-4d2b-8154-23233b1a3d05"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:51.424099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:51.432007 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.432932 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.433564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.434164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.435158 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.435910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.780049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e66410db-48da-4dd9-beae-71db3774bf19 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363715 Sep 07 13:24:51.780785 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 424/883] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:24:51 2022] POST /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:51.832835 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:51.833484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:51.843444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.844113 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.844772 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.845513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.845965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.846579 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.977693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:51.978516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:51.987261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.988117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.988563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.989450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.989910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.990338 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.011259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.023468 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.025687 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.027618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4cc24b7f-27bd-4a9b-bce9-ab8fce765e34 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1672 microversion: 2.20 time: 0.199275 Sep 07 13:24:52.028444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 460/884] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:51 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:52.174831 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.184238 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8d894bd3-a826-470f-b1e3-f684c867f025 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.211166 Sep 07 13:24:52.185897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 425/885] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:51 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:53.053823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:53.054578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:53.061516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.062358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.062987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.063934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.064631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.065112 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.213510 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:53.214920 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:53.215959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:53.218278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:53.224159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.224681 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.225115 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.225819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.226297 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.226919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.228158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:53.240728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:53.243787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0fa6f7ad-a406-4197-8bdc-08dcb279134a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.193866 Sep 07 13:24:53.250900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 461/886] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:53 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:24:53.305421 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-53dc615d-3886-48ab-aa0d-02a2d28c65ff tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3def3aaf0>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:53.362136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-53dc615d-3886-48ab-aa0d-02a2d28c65ff tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/295d418c-84b7-4319-83bd-ba2b99d788ea" status: 200 len: 351 microversion: 2.1 time: 0.060882 Sep 07 13:24:53.362988 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 462/887] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:24:53 2022] GET /compute/v2.1/os-volumes/295d418c-84b7-4319-83bd-ba2b99d788ea => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:53.388550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:53.397529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-515c9155-826a-4e46-8370-25f7a7e268cf tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.189038 Sep 07 13:24:53.399208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 426/888] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:53 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:54.278356 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.279731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:54.286424 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.286920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.287396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.288098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.288592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.289242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.403613 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-e9ec4c93-4ecf-4e3a-b042-2df6253128ce req-eafd5ed7-1c7b-4687-bc81-910121686367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a643bbd7-7da9-4fc5-a154-c46f0c2834f3", "name": "network-vif-plugged", "status": "completed", "tag": "d24831c0-0afc-4520-8128-ae3c95f534e4"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:54.427531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e9ec4c93-4ecf-4e3a-b042-2df6253128ce req-eafd5ed7-1c7b-4687-bc81-910121686367 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.428046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e9ec4c93-4ecf-4e3a-b042-2df6253128ce req-eafd5ed7-1c7b-4687-bc81-910121686367 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.428543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e9ec4c93-4ecf-4e3a-b042-2df6253128ce req-eafd5ed7-1c7b-4687-bc81-910121686367 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.539123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.549809 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.551278 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.552497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9e9bc621-64e6-4cc9-8547-b34ab99032ae tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.279361 Sep 07 13:24:54.553064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 463/889] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:54 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:54.565107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.565996 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:54.572776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.579948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.580677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.581604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.582234 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.582874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.691874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-e9ec4c93-4ecf-4e3a-b042-2df6253128ce req-eafd5ed7-1c7b-4687-bc81-910121686367 service nova] Creating event network-vif-plugged:d24831c0-0afc-4520-8128-ae3c95f534e4 for instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 on hv-cinder-80403 Sep 07 13:24:54.724550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-e9ec4c93-4ecf-4e3a-b042-2df6253128ce req-eafd5ed7-1c7b-4687-bc81-910121686367 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324816 Sep 07 13:24:54.725572 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 427/890] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:54.753382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-efe91d7a-752f-46d3-ba6f-b445f037377f tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3dee74790>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.771831 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.779486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-01369b0d-5bc4-4d73-899f-935dc78cefa2 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.225398 Sep 07 13:24:54.780054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 464/891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:54 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:54.803618 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-efe91d7a-752f-46d3-ba6f-b445f037377f tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fdac6434-f812-4d7d-b32c-bed0cbd16733" status: 200 len: 350 microversion: 2.1 time: 0.055564 Sep 07 13:24:54.804736 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 428/892] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:24:54 2022] GET /compute/v2.1/os-volumes/fdac6434-f812-4d7d-b32c-bed0cbd16733 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:55.597755 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:55.599668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:55.611515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.612429 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.613135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:55.615194 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.615671 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.616140 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:55.792139 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:55.804417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:55.804938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:55.805755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:55.807356 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:55.809883 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a9166715-cfe9-4132-b8a4-0640afbea269 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.217523 Sep 07 13:24:55.817229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.818122 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.818763 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:55.819737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.820387 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.821013 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:55.824900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 465/893] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:55 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:55.975380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:55.989219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-148ab2ee-c00b-46b7-93e5-0c284659b084 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.189517 Sep 07 13:24:55.990030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 429/894] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:55 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:56.206305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8fade59e-48eb-4379-acf5-902e6924e026 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3def3ac10>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.258585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8fade59e-48eb-4379-acf5-902e6924e026 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/439a17d3-c66b-4597-8545-aa5a0d9b5d81" status: 200 len: 351 microversion: 2.1 time: 0.056136 Sep 07 13:24:56.259266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 466/895] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes/439a17d3-c66b-4597-8545-aa5a0d9b5d81 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:56.272044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a8598708-1b3c-4b64-b2e0-901b082634c7 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3dee74700>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.358082 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a8598708-1b3c-4b64-b2e0-901b082634c7 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089687 Sep 07 13:24:56.358722 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 430/896] 10.222.0.61 () {58 vars in 1134 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:56.377803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5f4818f7-3bc7-430e-97d3-d3a31172e0e9 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3db644a60>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.495871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5f4818f7-3bc7-430e-97d3-d3a31172e0e9 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.125752 Sep 07 13:24:56.496478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 467/897] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:56.513254 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b12572fd-b1c6-4a01-9405-d0b59aa7677e tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3def24a60>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.606666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b12572fd-b1c6-4a01-9405-d0b59aa7677e tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.097748 Sep 07 13:24:56.607307 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 431/898] 10.222.0.61 () {58 vars in 1134 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:56.621537 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bf949b1f-ce65-4016-b614-7f6da66ec8cc tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3def16820>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.715650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bf949b1f-ce65-4016-b614-7f6da66ec8cc tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098839 Sep 07 13:24:56.716314 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 468/899] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:56.733877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1badee6f-dd77-41ab-8001-55f877a3502a tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3deef79d0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.825147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1badee6f-dd77-41ab-8001-55f877a3502a tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095072 Sep 07 13:24:56.836858 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 432/900] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:56.846601 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4e2441f8-24be-4003-9edc-d405f407c85c tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3dee74f70>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.847232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:56.847867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:56.855913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:56.856423 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:56.856993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:56.857777 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:56.858442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:56.858881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:56.942196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4e2441f8-24be-4003-9edc-d405f407c85c tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099247 Sep 07 13:24:56.942734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 433/901] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:56.955984 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7230612c-4efc-42cd-b1b3-86fc7c440677 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3dee74ee0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:57.037401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:57.051329 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:57.053229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:57.055259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7fa4efaf-0472-486b-92b3-6354ddb0836d tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.217006 Sep 07 13:24:57.070602 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7230612c-4efc-42cd-b1b3-86fc7c440677 tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.118242 Sep 07 13:24:57.071680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 469/902] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:57.072325 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 434/903] 10.222.0.61 () {58 vars in 1188 bytes} [Wed Sep 7 13:24:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:57.076671 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:57.077516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:57.086520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.088073 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.089608 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.090645 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.091669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.092398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.111201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-934895f5-afb0-47f4-8b0e-4f91826a4fee tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] Calling method '.version_select at 0x7fa3def248b0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:57.244101 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-934895f5-afb0-47f4-8b0e-4f91826a4fee tempest-VolumesTestJSON-1299900586 tempest-VolumesTestJSON-1299900586-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143862 Sep 07 13:24:57.245611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 435/904] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Sep 7 13:24:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:57.328478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:57.337252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5bca67d7-7d07-437b-b32f-87dd50916ffb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.264402 Sep 07 13:24:57.337833 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 470/905] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:57 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:58.082733 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:58.083923 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:58.090748 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.091556 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.092159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.093039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.093663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.094255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.241321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:58.254552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:58.256604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:58.258479 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0dcccf01-2526-4238-b0a6-059486b114a5 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.180522 Sep 07 13:24:58.259123 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 436/906] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:58 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:58.363495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:58.365434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:58.375624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.376580 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.377263 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.378285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.378992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.379674 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.527349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:58.535641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8e5b38ec-02ab-4bb4-b32f-ecbaa2ca9353 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.177397 Sep 07 13:24:58.536269 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 471/907] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:58 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:59.284873 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:59.285676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:59.293874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.295068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.296138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.297106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.298695 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.299786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.451210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:59.455388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=6,nova_cell1:UPDATE=10 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:59.464934 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:59.467713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:59.469344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-46a6b7fb-1b8d-4be7-a78b-ea7470edd2e9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.188885 Sep 07 13:24:59.469985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 437/908] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:59 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:59.566077 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:59.567695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:59.581038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.581651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.583649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.584670 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.585156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.585690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.790471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:59.808352 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-da3f498b-ea46-46f5-82d5-468fba26b00e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.246299 Sep 07 13:24:59.808940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 472/909] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:59 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:00.496121 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:00.496760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:00.504596 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.505368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.505993 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:00.506694 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.507700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.508128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:00.659041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:00.667564 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:00.669023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:00.670188 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-31ef52d2-fa05-4d2a-b288-8059144d6eda tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.177952 Sep 07 13:25:00.670743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 438/910] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:00 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:00.838660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:00.839407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:00.846785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.847326 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.847770 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:00.848517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.848979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.849388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.032112 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:01.040507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-41aef312-dd34-4445-bca7-d8f933873b2c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.206575 Sep 07 13:25:01.041091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 473/911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:00 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:01.700441 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:01.701690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:01.710039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.711077 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.711809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.712754 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.713371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.714083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.894046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:01.903786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:01.905765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:01.907363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-be831320-c8a4-4952-bd1f-e21fb85a7be0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.213807 Sep 07 13:25:01.908108 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 439/912] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:01 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:02.064873 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:02.065798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:02.075650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.076252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.076866 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.077693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.078261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.078986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.232953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:02.240985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-350d7117-069e-4b0b-b244-5661417ae9df tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.180666 Sep 07 13:25:02.242451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 474/913] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:02 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:02.933305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:02.933921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:02.940466 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.940969 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.941405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.942107 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.942563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.942993 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.085068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:03.095425 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:03.096911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:03.098130 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6bd107e1-42c1-4635-afe5-e7907680834e tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.168913 Sep 07 13:25:03.098724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 440/914] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:02 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:03.264649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:03.265262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:03.271820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:03.272309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.272826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.273426 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:03.273951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.274305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.422722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:03.431243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d5b003fb-3b13-4a6c-bd1e-05bdab4a90bc tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.170564 Sep 07 13:25:03.431815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 475/915] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:03 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:04.124870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:04.125541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:04.133687 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.134194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.134863 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.135651 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.136132 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.136563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.309181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:04.318517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:04.319663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:04.321243 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a53a0954-8743-4f8e-b410-708ec59c0fbe tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.200295 Sep 07 13:25:04.339224 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 441/916] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:04 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:04.454252 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:04.454863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:04.461611 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.462103 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.462541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.463296 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.463751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.464394 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.601874 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:04.610257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dec7b5e5-4341-4740-82d7-1318ff53cdfd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.160239 Sep 07 13:25:04.620627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 476/917] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:04 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:05.348543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:05.349100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:05.356401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.356886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.357320 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.358028 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.358475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.358892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.495642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:05.504086 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:05.505637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:05.506950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-edca91d1-78fd-4629-ba9e-1bfbef89009b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.162770 Sep 07 13:25:05.507627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 442/918] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:05 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:05.633670 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:05.634196 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:05.640678 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.641159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.641593 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.642290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.642746 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.643192 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.783996 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:05.793714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bc128117-ccd3-4afc-a322-6f5ff7d36c6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1266 microversion: 2.1 time: 0.163261 Sep 07 13:25:05.793714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 477/919] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:05 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:05.871574 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:05.874091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:05.880568 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.881212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.881665 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.882922 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.883435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.884031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.917747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-328706c7-8dc5-4cc9-9a8f-6d0a2c6f2d67 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050260 Sep 07 13:25:05.918483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 443/920] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:25:05 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:05.929128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:05.929662 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:05.935914 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.936411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.936847 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.937554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.938011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.938441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.970123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-374476c9-f019-4292-90ad-14453cbe92fb tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/c3556478-b614-4d2b-8154-23233b1a3d05" status: 200 len: 194 microversion: 2.1 time: 0.044906 Sep 07 13:25:05.970853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 478/921] 10.222.0.61 () {58 vars in 1413 bytes} [Wed Sep 7 13:25:05 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/c3556478-b614-4d2b-8154-23233b1a3d05 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:06.535286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:06.535912 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:06.542753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.543300 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.543745 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.544470 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.544935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.545375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.717882 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:06.731947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:06.733749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:06.735163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f78f7ca5-b2ca-4e03-841e-ba2e26799b59 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.204500 Sep 07 13:25:06.747539 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 444/922] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:06 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:06.817743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:06.818598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:06.825643 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.826210 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.826724 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.827547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.828068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.828664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.963345 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:06.971414 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8ed2b11d-033b-4a05-b02e-561a57b63e15 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1452 microversion: 2.1 time: 0.158110 Sep 07 13:25:06.971998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 479/923] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:06 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:06.994777 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:06.995481 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:07.001689 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.002458 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.002957 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.003741 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.004209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.004665 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.204079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:07.212380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-697d0f7e-0888-4073-a88c-c8ba00f4080c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1452 microversion: 2.1 time: 0.221482 Sep 07 13:25:07.212945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 445/924] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:06 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1452 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:07.328524 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1955635e-9dfa-48a2-a65c-291f07837717"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:07.330969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:07.338857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.339434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.341828 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.342260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.342728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.343207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.656908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8ba22527-77b6-4bd9-9db2-397173b06791 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "POST /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332162 Sep 07 13:25:07.657732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 480/925] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:25:07 2022] POST /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:07.764347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:07.765779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:07.773394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.773921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.774320 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.775672 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.776145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.776671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.260295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:08.269835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:08.271382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:08.272480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-27e443af-489f-4501-a64b-3c9490754dc9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.512047 Sep 07 13:25:08.273047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 446/926] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:07 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:25:08.577956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-1618dd0e-8990-4781-bbc0-d0cc26291719 req-6788fdf5-e030-44b3-aa2e-60b727639cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38430858-246f-449d-9580-9747b3bf22e0", "name": "network-vif-plugged", "status": "completed", "tag": "d25ce013-3fdb-4ed2-9267-0c86e2ba62b0"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:08.588857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-1618dd0e-8990-4781-bbc0-d0cc26291719 req-6788fdf5-e030-44b3-aa2e-60b727639cf5 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.589335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-1618dd0e-8990-4781-bbc0-d0cc26291719 req-6788fdf5-e030-44b3-aa2e-60b727639cf5 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.589766 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-1618dd0e-8990-4781-bbc0-d0cc26291719 req-6788fdf5-e030-44b3-aa2e-60b727639cf5 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.594479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:08.603089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-1618dd0e-8990-4781-bbc0-d0cc26291719 req-6788fdf5-e030-44b3-aa2e-60b727639cf5 service nova] Creating event network-vif-plugged:d25ce013-3fdb-4ed2-9267-0c86e2ba62b0 for instance 38430858-246f-449d-9580-9747b3bf22e0 on hv-cinder-80403 Sep 07 13:25:08.608710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-1618dd0e-8990-4781-bbc0-d0cc26291719 req-6788fdf5-e030-44b3-aa2e-60b727639cf5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Sep 07 13:25:08.609528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 481/927] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:09.127579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-d483a48c-3bb4-4b89-884c-0edb7e9533e5 req-28777abd-a155-40d8-a08a-0e3797327d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a643bbd7-7da9-4fc5-a154-c46f0c2834f3", "tag": "d24831c0-0afc-4520-8128-ae3c95f534e4"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:09.138153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d483a48c-3bb4-4b89-884c-0edb7e9533e5 req-28777abd-a155-40d8-a08a-0e3797327d11 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.138554 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d483a48c-3bb4-4b89-884c-0edb7e9533e5 req-28777abd-a155-40d8-a08a-0e3797327d11 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.138995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d483a48c-3bb4-4b89-884c-0edb7e9533e5 req-28777abd-a155-40d8-a08a-0e3797327d11 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.150074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-d483a48c-3bb4-4b89-884c-0edb7e9533e5 req-28777abd-a155-40d8-a08a-0e3797327d11 service nova] Creating event network-changed:d24831c0-0afc-4520-8128-ae3c95f534e4 for instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 on hv-cinder-80403 Sep 07 13:25:09.155359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-d483a48c-3bb4-4b89-884c-0edb7e9533e5 req-28777abd-a155-40d8-a08a-0e3797327d11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031337 Sep 07 13:25:09.155971 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 447/928] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:09.300362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:09.301151 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:09.308487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.308970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.309406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.310100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.310559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.311036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.453256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:09.461767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:09.463435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:09.464695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-340a6dc9-8fb6-4712-9e41-909539731450 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.169495 Sep 07 13:25:09.465334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 482/929] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:09 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:10.491472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:10.492088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:10.498935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.499463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.499960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.500668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.501130 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.501555 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.631674 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:10.641517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:10.642976 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:10.644240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-17a890c9-5c02-493c-96da-2073174ff345 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.157370 Sep 07 13:25:10.644790 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 448/930] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:10 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:11.670408 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:11.671016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:11.677509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.677989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.678425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.679172 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.679637 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.680064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.808862 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:11.816884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:11.818362 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:11.820037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-50ed448f-499e-4379-bf61-e5eb0af2e596 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.153100 Sep 07 13:25:11.820592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 483/931] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:11 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:12.846042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:12.846666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:12.855711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:12.856207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:12.856705 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:12.857357 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:12.857818 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:12.858250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:12.992404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.000831 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.002294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.003486 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cee7e1e4-8b45-4c51-aa88-65c8f4dfa7b9 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.161516 Sep 07 13:25:13.004045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 449/932] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:12 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:14.029574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:14.030179 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:14.036663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.037152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.037585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.038274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.038727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.039178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.185331 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:14.193412 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:14.195438 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:14.196601 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-50768de4-abda-4b54-97cf-2d0988c84b7b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.170951 Sep 07 13:25:14.197165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 484/933] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:14 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:15.222106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:15.222716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:15.225196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=62 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:15.231199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:15.231685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:15.232132 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:15.232825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:15.233276 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:15.233696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:15.363253 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:15.371835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:15.373293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:15.374465 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d8ff2a43-841d-4ed1-a94c-5a5a79713124 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.156399 Sep 07 13:25:15.375029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 450/934] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:15 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:16.401532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:16.402084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:16.404659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:16.409966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:16.410476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:16.410917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:16.411648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:16.412107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:16.412536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:16.551782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:16.562380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:16.563510 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:16.564717 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a908bae3-663c-4eb0-a636-33fa4e1194b0 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.167969 Sep 07 13:25:16.565305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 485/935] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:16 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:17.592151 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:17.592757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:17.599461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:17.599956 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:17.600393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:17.601664 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:17.602112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:17.602530 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:17.750550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:17.760504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:17.762167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:17.763394 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-08a64a80-0401-46b6-a2a6-3e29b7578e42 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1728 microversion: 2.20 time: 0.175459 Sep 07 13:25:17.764269 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 451/936] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:17 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:18.790396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:18.791025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:18.797491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:18.797974 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:18.798396 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:18.799076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:18.799547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:18.799967 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:18.931603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:18.939699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:18.941166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:18.942323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bd2b1f8b-7861-4d67-bf87-b986c738ab64 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1715 microversion: 2.20 time: 0.156401 Sep 07 13:25:18.942878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 486/937] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:25:18 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:25:23.731884 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:23.734098 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:23.740906 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.741381 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.741848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.742643 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.743127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.743571 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.779603 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2dcb4f93-5ca1-43cb-9603-3fbc33a7cd7e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052573 Sep 07 13:25:23.780794 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 452/938] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:25:23 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:23.942857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:23.943459 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:23.950375 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.950856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.951334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.952027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.952477 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.952903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.984554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-10856881-488c-4722-ad4d-59d15a3107ab tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/c3556478-b614-4d2b-8154-23233b1a3d05" status: 200 len: 194 microversion: 2.1 time: 0.045747 Sep 07 13:25:23.985160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 487/939] 10.222.0.61 () {58 vars in 1413 bytes} [Wed Sep 7 13:25:23 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/c3556478-b614-4d2b-8154-23233b1a3d05 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:23.995986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:23.996406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:24.002337 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:24.002855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:24.003328 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:24.004023 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:24.004490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:24.004918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:24.087958 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lazy-loading 'services' on Instance uuid 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:24.160495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ab2b9421-4eda-45dd-a290-36f367de1fe1 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/c3556478-b614-4d2b-8154-23233b1a3d05" status: 202 len: 0 microversion: 2.1 time: 0.168429 Sep 07 13:25:24.161087 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 453/940] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:25:23 2022] DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/c3556478-b614-4d2b-8154-23233b1a3d05 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:25:29.548739 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:29.549225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:29.555940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:29.556427 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:29.556868 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:29.557563 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:29.558022 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:29.558452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:29.589451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b2952810-a84b-4f1a-a50d-99ed10900c42 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/1955635e-9dfa-48a2-a65c-291f07837717" status: 200 len: 194 microversion: 2.1 time: 0.044587 Sep 07 13:25:29.590048 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 488/941] 10.222.0.61 () {58 vars in 1413 bytes} [Wed Sep 7 13:25:29 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/1955635e-9dfa-48a2-a65c-291f07837717 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:29.604227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:29.605224 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:29.611274 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:29.611773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:29.612212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:29.612928 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:29.613388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:29.613814 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:29.633041 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:29.696516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lazy-loading 'services' on Instance uuid 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:29.771789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0a1129db-ffba-42e6-8738-ba2abee8ca9e tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/1955635e-9dfa-48a2-a65c-291f07837717" status: 202 len: 0 microversion: 2.1 time: 0.174836 Sep 07 13:25:29.772383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 454/942] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:25:29 2022] DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments/1955635e-9dfa-48a2-a65c-291f07837717 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:25:35.195465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:35.197639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:35.204210 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.204693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.205132 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.205870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.206336 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.206757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.241878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-032d708c-bff7-4837-8cea-01bb4dd9a5dc tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050304 Sep 07 13:25:35.242452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 489/943] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:25:35 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:25:35.378241 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:35.380696 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:35.387621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.388122 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.388559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.389270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.389725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.390150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.421256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4197c1f7-dd38-49f4-b931-da7d4987e289 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047884 Sep 07 13:25:35.421837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 455/944] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:25:35 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:25:35.489556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:35.490084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:35.496355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.496839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.497284 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.497993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.498450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.498878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.524680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:25:35.601896 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4058d23e-7aa9-4842-983b-684df5d328ed tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 204 len: 0 microversion: 2.1 time: 0.115839 Sep 07 13:25:35.602595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 490/945] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:25:35 2022] DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:25:35.612290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:35.612900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:35.619044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.619563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.620004 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.620703 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.621158 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.621584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.765166 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:35.778740 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-81232905-b550-4cc5-b0b2-dc4a2c80431f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1671 microversion: 2.1 time: 0.171191 Sep 07 13:25:35.779679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 456/946] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:35 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:36.817893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:36.818659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:36.825513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.825991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.826415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.827096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.827576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.827991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.958545 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:36.966991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-af81cba7-1c1b-4c89-b2e8-15f2cafc94bd tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1671 microversion: 2.1 time: 0.153653 Sep 07 13:25:36.967601 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 491/947] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:36 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:37.990702 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:37.991357 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:37.998133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.998637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.999079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.999821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:38.000283 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:38.000716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:38.138009 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:38.145955 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ce5511d8-2bc4-462f-a4d2-caa79190c633 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1671 microversion: 2.1 time: 0.159742 Sep 07 13:25:38.146524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 457/948] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:37 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:39.171202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:39.171836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:39.178616 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:39.179119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:39.179622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:39.180270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:39.180721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:39.181142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:39.332242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:39.335530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:39.346182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1652068d-c4ec-4db0-b497-47e70f26b151 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1671 microversion: 2.1 time: 0.180037 Sep 07 13:25:39.347085 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 492/949] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:39 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:39.818374 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-2b65e7f6-8e2d-45db-91a7-842cf54730ee req-29e7b7fa-4ccf-4e23-9550-f6c8e618dc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308", "name": "network-vif-deleted", "tag": "5bd82742-b876-457e-a7e2-01683b424513"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:39.841315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-2b65e7f6-8e2d-45db-91a7-842cf54730ee req-29e7b7fa-4ccf-4e23-9550-f6c8e618dc7f service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:39.841824 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-2b65e7f6-8e2d-45db-91a7-842cf54730ee req-29e7b7fa-4ccf-4e23-9550-f6c8e618dc7f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:39.842275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-2b65e7f6-8e2d-45db-91a7-842cf54730ee req-29e7b7fa-4ccf-4e23-9550-f6c8e618dc7f service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:39.876232 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-2b65e7f6-8e2d-45db-91a7-842cf54730ee req-29e7b7fa-4ccf-4e23-9550-f6c8e618dc7f service nova] Creating event network-vif-deleted:5bd82742-b876-457e-a7e2-01683b424513 for instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 on hv-cinder-80403 Sep 07 13:25:39.889045 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-2b65e7f6-8e2d-45db-91a7-842cf54730ee req-29e7b7fa-4ccf-4e23-9550-f6c8e618dc7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074176 Sep 07 13:25:39.892891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 458/950] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:40.371398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:40.373287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:40.389724 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:40.390355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:40.391001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:40.392386 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:40.393322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:40.394233 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:40.427033 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:40.427568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:40.428004 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:40.428487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lazy-loading 'fault' on Instance uuid 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:40.483455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55eed583fac43fb9bfe1366a42bd2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb52045ffa14e94998e764c1dbc605e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:40.496343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dbcab36b-b6ed-4f67-95f1-da4f3730740c tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 200 len: 1327 microversion: 2.1 time: 0.129939 Sep 07 13:25:40.496943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 493/951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:40 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:41.521168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:41.521865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:41.528196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:41.528617 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:41.529062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:41.529866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:41.530214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:41.530641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:41.544399 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] HTTP exception thrown: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Request method failure captured: Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 HTTP/1.1 Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm7utizziep0dDmzTD_0xtfGx1kHX33TQGJCm4pWdFzdyA3WHxiN00L2ymL7-xh5nCorEclZCvX06q-keaeDGRc7l8gceyUIpSIQ8jncOtnR3hoTPYe0kWZwekTHz-sUki96TwEiRGp7Je2o9fZXXGAV-pcKnzJuQl8TJiXx6Gyl-Y Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:25:41.546083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccb52045ffa14e94998e764c1dbc605e"}]}] Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: b55eed583fac43fb9bfe1366a42bd2fc Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:41.547607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308'} Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:41.548429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:41.549753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:41.550947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Returning 404 to user: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:41.550947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-186ec513-a998-403c-a19b-8a619d2a4833 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 404 len: 111 microversion: 2.1 time: 0.030951 Sep 07 13:25:41.550947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 459/952] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:41 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:25:41.556471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a59cf2ab-f405-42af-8f56-970dd3a5ce0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '.version_select at 0x7fa3def16e50>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:41.576296 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a59cf2ab-f405-42af-8f56-970dd3a5ce0d tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163363899" status: 202 len: 0 microversion: 2.1 time: 0.023561 Sep 07 13:25:41.577088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 494/953] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Sep 7 13:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163363899 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:25:44.502519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.502910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:44.509274 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.509773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.510223 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.511501 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.511849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.512044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.528749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] HTTP exception thrown: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Request method failure captured: Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 HTTP/1.1 Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm7utizziep0dDmzTD_0xtfGx1kHX33TQGJCm4pWdFzdyA3WHxiN00L2ymL7-xh5nCorEclZCvX06q-keaeDGRc7l8gceyUIpSIQ8jncOtnR3hoTPYe0kWZwekTHz-sUki96TwEiRGp7Je2o9fZXXGAV-pcKnzJuQl8TJiXx6Gyl-Y Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:25:44.530452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccb52045ffa14e94998e764c1dbc605e"}]}] Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: b55eed583fac43fb9bfe1366a42bd2fc Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.532090 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308'} Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:44.533050 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.534511 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.535951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Returning 404 to user: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:44.535951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6caf323d-1c16-4f95-beed-6db076c8dfae tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 404 len: 111 microversion: 2.1 time: 0.034285 Sep 07 13:25:44.535951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 460/954] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:25:44 2022] DELETE /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:25:44.541165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.542303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:44.549916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.550406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.550914 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.551795 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.552743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.552743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.568733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] HTTP exception thrown: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Request method failure captured: Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 HTTP/1.1 Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJm7utizziep0dDmzTD_0xtfGx1kHX33TQGJCm4pWdFzdyA3WHxiN00L2ymL7-xh5nCorEclZCvX06q-keaeDGRc7l8gceyUIpSIQ8jncOtnR3hoTPYe0kWZwekTHz-sUki96TwEiRGp7Je2o9fZXXGAV-pcKnzJuQl8TJiXx6Gyl-Y Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:25:44.570435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccb52045ffa14e94998e764c1dbc605e"}]}] Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: b55eed583fac43fb9bfe1366a42bd2fc Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.573416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308'} Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:44.575368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. Sep 07 13:25:44.579405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:44.584905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Returning 404 to user: Instance 3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:44.584905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e52188a4-235a-4990-a88d-94ddeea54ff5 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308" status: 404 len: 111 microversion: 2.1 time: 0.035110 Sep 07 13:25:44.584905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 495/955] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:44 2022] GET /compute/v2.1/servers/3d36a6e0-09a0-4f2d-a9a6-cdc6f81de308 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:25:45.723304 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:45.723834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:45.726204 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=22 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:45.732267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:45.732756 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:45.733191 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:45.733895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:45.734354 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:45.734780 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:45.749829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] HTTP exception thrown: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Request method failure captured: Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: DELETE /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 HTTP/1.1 Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJm7utizziep0dDmzTD_0xtfGx1kHX33TQGJCm4pWdFzdyA3WHxiN00L2ymL7-xh5nCorEclZCvX06q-keaeDGRc7l8gceyUIpSIQ8jncOtnR3hoTPYe0kWZwekTHz-sUki96TwEiRGp7Je2o9fZXXGAV-pcKnzJuQl8TJiXx6Gyl-Y Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:25:45.751504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccb52045ffa14e94998e764c1dbc605e"}]}] Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: b55eed583fac43fb9bfe1366a42bd2fc Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.753114 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6'} Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:45.753972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.755412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.756861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Returning 404 to user: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:45.756861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a1bfd2f8-58e9-4730-ba9a-601ee824110f tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 404 len: 111 microversion: 2.1 time: 0.033648 Sep 07 13:25:45.756861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 461/956] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:25:45 2022] DELETE /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:25:45.761888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:45.762531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] [instance: 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:45.769327 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:45.769820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:45.770261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:45.770969 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:45.771475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:45.771905 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:45.786443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] HTTP exception thrown: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Request method failure captured: Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 HTTP/1.1 Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJm7utizziep0dDmzTD_0xtfGx1kHX33TQGJCm4pWdFzdyA3WHxiN00L2ymL7-xh5nCorEclZCvX06q-keaeDGRc7l8gceyUIpSIQ8jncOtnR3hoTPYe0kWZwekTHz-sUki96TwEiRGp7Je2o9fZXXGAV-pcKnzJuQl8TJiXx6Gyl-Y Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:25:45.788023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccb52045ffa14e94998e764c1dbc605e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccb52045ffa14e94998e764c1dbc605e"}]}] Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: ccb52045ffa14e94998e764c1dbc605e Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-401184594 Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: b55eed583fac43fb9bfe1366a42bd2fc Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeTestJSON-401184594-project Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.789625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6'} Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:45.790529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. Sep 07 13:25:45.793007 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:25:45.794385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] Returning 404 to user: Instance 4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:45.794385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-949b36d3-c742-40a7-a46e-a6ca02fdf560 tempest-AttachVolumeTestJSON-401184594 tempest-AttachVolumeTestJSON-401184594-project] 10.222.0.61 "GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6" status: 404 len: 111 microversion: 2.1 time: 0.031778 Sep 07 13:25:45.794385 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 496/957] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:45 2022] GET /compute/v2.1/servers/4f262bbe-ef6c-4a40-b4c7-ccbf0ac77ab6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:25:50.812978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-339787156", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:50.869512 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] validate_networks() for None {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:25:51.172525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:25:51.172949 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:25:51.173427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:25:51.173942 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:25:51.174251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:25:51.183999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:51.184483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:51.185021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:51.185919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:51.186561 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:51.186997 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:51.206690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Getting quotas for project 6e99d17eda624e1284d6a01e72deddab. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:51.217178 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Getting quotas for user a61664af3f594375ac41c8aa7423627f and project 6e99d17eda624e1284d6a01e72deddab. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:51.231001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:25:51.233599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:25:51.277860 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [cc53c0ae-4db8-4ddc-a5a7-6d6faae99b67] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:25:52.287413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO oslo.messaging._drivers.impl_rabbit [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [cc53c0ae-4db8-4ddc-a5a7-6d6faae99b67] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 33914. Sep 07 13:25:52.292425 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-59b52e0e-4996-48d1-a62d-c400fa144d36 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482939 Sep 07 13:25:52.294943 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 462/958] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:25:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:25:52.305876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4c9c57ac-e260-4961-8c5a-18b2ad27171b tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:52.306474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4c9c57ac-e260-4961-8c5a-18b2ad27171b tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:52.319846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:52.387597 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4c9c57ac-e260-4961-8c5a-18b2ad27171b tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:52.396622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4c9c57ac-e260-4961-8c5a-18b2ad27171b tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1214 microversion: 2.1 time: 0.094476 Sep 07 13:25:52.416911 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 497/959] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:52 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:53.425238 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:53.426493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:53.433345 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:53.434217 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:53.434750 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:53.435725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:53.436513 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:53.437182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:53.566616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:53.581302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d7ef9de0-f049-4ddc-a818-2dc4586b3feb tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1266 microversion: 2.1 time: 0.157499 Sep 07 13:25:53.581919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 463/960] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:53 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:54.605964 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:54.607666 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:54.626918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:54.631119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:54.631908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:54.632831 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:54.635791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:54.636247 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:54.790050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:54.808443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-651c3b12-39ba-4d1c-a677-ea29afc624b1 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1272 microversion: 2.1 time: 0.206409 Sep 07 13:25:54.810620 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 498/961] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:54 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:55.841178 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:55.844247 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:55.853635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:55.854694 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:55.855427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:55.856145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:55.856735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:55.857270 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:56.041255 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-58aa551b-2924-4f18-bb41-690abb03ce6a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: .version_select at 0x7fa3def16af0>, body: {"keypair": {"name": "tempest-keypair-1408190779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBQz3pvF4OyHHk7I6YOFiHpTHL9+isuTrmUkrckDeeNcs3NGDZhO2/jiwsN7Bz4ytEb7GHfY4arVeMHNh2Wrpnykbw/RBF1eD/TjZ1NnRIeZzD2n8anKj/KGECr1vMYiw=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:56.066670 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-58aa551b-2924-4f18-bb41-690abb03ce6a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:56.073670 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-58aa551b-2924-4f18-bb41-690abb03ce6a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:56.113110 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-58aa551b-2924-4f18-bb41-690abb03ce6a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.281204 Sep 07 13:25:56.114447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 499/962] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:25:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:56.178556 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:56.190266 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1c4f9abe-a035-4407-9333-55c10e4bb6b8 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.359399 Sep 07 13:25:56.191434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 464/963] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:55 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:56.764262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-b74f52c0-3063-41df-8a3a-0534e316e08b req-323123ce-bf1c-4581-9059-d936495025a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d15324b-0905-4df2-b15a-3ca152c80714", "tag": "bb2ed752-fee4-4f33-83b3-bce90421f28f"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:56.782711 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b74f52c0-3063-41df-8a3a-0534e316e08b req-323123ce-bf1c-4581-9059-d936495025a9 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:56.783598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b74f52c0-3063-41df-8a3a-0534e316e08b req-323123ce-bf1c-4581-9059-d936495025a9 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:56.784376 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-b74f52c0-3063-41df-8a3a-0534e316e08b req-323123ce-bf1c-4581-9059-d936495025a9 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:56.803802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-b74f52c0-3063-41df-8a3a-0534e316e08b req-323123ce-bf1c-4581-9059-d936495025a9 service nova] Creating event network-changed:bb2ed752-fee4-4f33-83b3-bce90421f28f for instance 4d15324b-0905-4df2-b15a-3ca152c80714 on hv-cinder-80403 Sep 07 13:25:56.817094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-b74f52c0-3063-41df-8a3a-0534e316e08b req-323123ce-bf1c-4581-9059-d936495025a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057754 Sep 07 13:25:56.817967 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 500/964] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:57.215910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:57.216682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:57.224786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:57.225496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:57.226144 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:57.226857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:57.227506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:57.228142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:57.467708 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:57.481193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1d89645e-a5d4-4109-b7ce-cfb60c7d02ce tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.269474 Sep 07 13:25:57.482423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 465/965] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:57 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:57.983727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-965101918", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f60d918-dbd5-4067-8b15-8a46dcb0e077"}], "security_groups": [{"name": "tempest-securitygroup--2154253"}], "key_name": "tempest-keypair-1408190779", "user_data": "}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:58.109660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] validate_networks() for [('6f60d918-dbd5-4067-8b15-8a46dcb0e077', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:25:58.505294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:58.505982 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:58.517016 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.519229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.520554 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.521585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.522280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.523450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.552411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:25:58.552836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:25:58.553318 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:25:58.553722 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:25:58.554133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:25:58.569270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.569750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.570178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.571136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.571790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.573106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.605727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:58.619714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:58.642919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:25:58.646794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:25:58.720253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bfc7ac75-c096-4edb-9140-93e684cc7fe7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.742428 Sep 07 13:25:58.721175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 501/966] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:25:57 2022] POST /compute/v2.1/servers => generated 399 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:25:58.735730 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:58.746157 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e9fa8bd0-ab79-4b73-a282-64350bfa6931 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:58.746543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c8d8c6a3-bcd8-4840-8d7d-f3e1fde1b0f3 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.245514 Sep 07 13:25:58.746787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e9fa8bd0-ab79-4b73-a282-64350bfa6931 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:58.760157 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 466/967] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:58 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:58.817273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9fa8bd0-ab79-4b73-a282-64350bfa6931 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:58.826907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e9fa8bd0-ab79-4b73-a282-64350bfa6931 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1241 microversion: 2.1 time: 0.098287 Sep 07 13:25:58.828077 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 502/968] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:58 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:59.771294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:59.771908 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:59.778874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.779528 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.779968 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.780863 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.781173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.781646 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.786191 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:59.860726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:59.861980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:59.870199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.870516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.871000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.871867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.872220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.872651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.961586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:59.969916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3700a91c-b827-4f77-a4a6-3b3c59d94bb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1293 microversion: 2.1 time: 0.113831 Sep 07 13:25:59.970580 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 503/969] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:59 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:59.978218 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:59.991597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-71129975-7337-4efe-97c7-567d5d24e9d6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.224393 Sep 07 13:25:59.992583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 467/970] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:59 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:00.995880 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:00.997196 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:01.004501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.004899 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.005332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.006047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.006763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.007213 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.022296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:01.023230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:01.031989 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.032622 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.033364 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.034390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.034849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.035493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.090926 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:01.099669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9e9d4b54-a2d0-48ae-bc1c-6fda80066ccc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1299 microversion: 2.1 time: 0.108315 Sep 07 13:26:01.100835 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 504/971] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:00 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:01.195487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:01.199743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:01.207967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9cd3c354-a948-4b67-bd66-b7bd5d7fa2bc tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.195871 Sep 07 13:26:01.208546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 468/972] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:01 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:02.066216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-165462f2-4167-4a18-8e42-b40e11b54fac req-c1c73e7e-3b15-4afc-b0ed-045ff69d2342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156e28cf-a566-4a1e-a235-d7715056d589", "tag": "3c8f2eb1-daca-468f-b34d-654e5ebdefd6"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:02.082073 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-165462f2-4167-4a18-8e42-b40e11b54fac req-c1c73e7e-3b15-4afc-b0ed-045ff69d2342 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.083052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-165462f2-4167-4a18-8e42-b40e11b54fac req-c1c73e7e-3b15-4afc-b0ed-045ff69d2342 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.084150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-165462f2-4167-4a18-8e42-b40e11b54fac req-c1c73e7e-3b15-4afc-b0ed-045ff69d2342 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.101259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-165462f2-4167-4a18-8e42-b40e11b54fac req-c1c73e7e-3b15-4afc-b0ed-045ff69d2342 service nova] Creating event network-changed:3c8f2eb1-daca-468f-b34d-654e5ebdefd6 for instance 156e28cf-a566-4a1e-a235-d7715056d589 on hv-cinder-80403 Sep 07 13:26:02.107089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-165462f2-4167-4a18-8e42-b40e11b54fac req-c1c73e7e-3b15-4afc-b0ed-045ff69d2342 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044542 Sep 07 13:26:02.107986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 505/973] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:02.128582 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:02.130751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:02.133142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:02.142145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.142643 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.143073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.143813 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.144262 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.144683 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.231514 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:02.232249 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:02.241521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.242360 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.243030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.243987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.245343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.245859 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.316636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:02.325937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9608728a-67c2-40a7-b639-c0e46e5c5d20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.202164 Sep 07 13:26:02.326719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 469/974] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:02 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:02.416211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:02.425175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-96c5d55e-babc-498b-91d6-2bed1e0297dd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.198252 Sep 07 13:26:02.425761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 506/975] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:02 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:02.772344 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-e65cb1a6-bc1d-4816-aa44-2b9560fa629a req-09727c61-1049-4116-a417-1ad5c4d74832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d15324b-0905-4df2-b15a-3ca152c80714", "name": "network-vif-plugged", "status": "completed", "tag": "bb2ed752-fee4-4f33-83b3-bce90421f28f"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:02.783075 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e65cb1a6-bc1d-4816-aa44-2b9560fa629a req-09727c61-1049-4116-a417-1ad5c4d74832 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.783546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e65cb1a6-bc1d-4816-aa44-2b9560fa629a req-09727c61-1049-4116-a417-1ad5c4d74832 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.784018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-e65cb1a6-bc1d-4816-aa44-2b9560fa629a req-09727c61-1049-4116-a417-1ad5c4d74832 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.797248 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-e65cb1a6-bc1d-4816-aa44-2b9560fa629a req-09727c61-1049-4116-a417-1ad5c4d74832 service nova] Creating event network-vif-plugged:bb2ed752-fee4-4f33-83b3-bce90421f28f for instance 4d15324b-0905-4df2-b15a-3ca152c80714 on hv-cinder-80403 Sep 07 13:26:02.802413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-e65cb1a6-bc1d-4816-aa44-2b9560fa629a req-09727c61-1049-4116-a417-1ad5c4d74832 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034026 Sep 07 13:26:02.803011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 470/976] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:03.350259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:03.350902 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:03.357845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:03.358330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:03.358771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:03.359509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:03.359960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:03.360389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:03.449781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:03.450469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:03.457477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:03.457964 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:03.458398 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:03.459093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:03.459584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:03.460006 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:03.553011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:03.562023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-726385f4-47c4-4b24-96ed-320c2f313a53 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.215842 Sep 07 13:26:03.562617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 507/977] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:03 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:03.623351 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:03.631125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-efe930a3-26cb-432b-8288-976f5b056342 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.185758 Sep 07 13:26:03.631693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 471/978] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:03 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:04.585281 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:04.586010 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:04.593662 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.594157 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.594651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.595406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.595866 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.596312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.654290 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:04.655576 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:04.662532 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.663329 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.664311 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.665351 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.665967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.667152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.788330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:04.797029 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9684fcf7-962c-48c7-96ff-da83408482b9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.215724 Sep 07 13:26:04.797651 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 508/979] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:04 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:04.836156 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:04.844894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c60caec5-f04a-443b-b41c-7f41ab39f7bd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1314 microversion: 2.1 time: 0.194718 Sep 07 13:26:04.845470 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 472/980] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:04 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:05.822337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:05.823009 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:05.829521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.830000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.830438 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:05.831263 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.831616 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.832042 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:05.871974 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:05.873201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:05.882004 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.882520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.882963 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:05.883783 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.884252 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.884703 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.034502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:06.043622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bd661151-d533-4d48-b9a4-955a82eb8ec3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.225565 Sep 07 13:26:06.044309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 509/981] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:05 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:06.074083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:06.083150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8a2abcee-c0c2-4665-af3e-a22b90595e77 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1464 microversion: 2.1 time: 0.218070 Sep 07 13:26:06.083789 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 473/982] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:05 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1464 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:06.130407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:06.130900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:06.138801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:06.139532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:06.140454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.141549 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:06.142377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:06.143163 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.177100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:26:06.262948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-eae00bd1-a23d-4a97-a6a0-cfa9b95a24c6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 204 len: 0 microversion: 2.1 time: 0.135978 Sep 07 13:26:06.263502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 510/983] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:26:06 2022] DELETE /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:26:06.272072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:06.272995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:06.279752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:06.280251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:06.280713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.281398 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:06.281856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:06.282289 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.421834 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:06.430179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7dd48909-8e4f-4068-88f2-437d3834d292 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1470 microversion: 2.1 time: 0.162245 Sep 07 13:26:06.430773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 474/984] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:06 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:07.068299 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:07.069008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:07.079253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.079796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.080338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.081156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.081653 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.082084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.226849 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:07.236629 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9df39eec-f277-49d9-ab68-1cfe272aa701 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.172353 Sep 07 13:26:07.237234 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 511/985] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:07 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:07.454412 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:07.455024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:07.461883 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.462379 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.462851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.463800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.464264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.464689 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.609989 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:07.617884 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-10324d82-0a05-4957-9c33-d86b981e0dfd tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1470 microversion: 2.1 time: 0.167364 Sep 07 13:26:07.618451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 475/986] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:07 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:08.264886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:08.265513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:08.272250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.272737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.273180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.273881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.274338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.274797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.407353 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:08.415053 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0541ca32-9000-4ead-99d6-d19a1aef15b4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.154608 Sep 07 13:26:08.415658 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 512/987] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:08 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:08.642351 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:08.643913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:08.650633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.652106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.652106 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.652806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.653288 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.654459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.806169 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:08.815024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2b497c89-b5ec-4ccf-af67-31350689553f tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1470 microversion: 2.1 time: 0.176510 Sep 07 13:26:08.815955 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 476/988] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:08 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:08.860909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-e1b5446b-00a3-453a-89c0-aaaa8b1ddf86 req-48c35342-8f86-4f11-bfee-59b7d87e788a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156e28cf-a566-4a1e-a235-d7715056d589", "name": "network-vif-plugged", "status": "completed", "tag": "3c8f2eb1-daca-468f-b34d-654e5ebdefd6"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:08.867982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:08.867982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=14 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:08.876701 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e1b5446b-00a3-453a-89c0-aaaa8b1ddf86 req-48c35342-8f86-4f11-bfee-59b7d87e788a service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.877276 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e1b5446b-00a3-453a-89c0-aaaa8b1ddf86 req-48c35342-8f86-4f11-bfee-59b7d87e788a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.877789 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-e1b5446b-00a3-453a-89c0-aaaa8b1ddf86 req-48c35342-8f86-4f11-bfee-59b7d87e788a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.891602 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-e1b5446b-00a3-453a-89c0-aaaa8b1ddf86 req-48c35342-8f86-4f11-bfee-59b7d87e788a service nova] Creating event network-vif-plugged:3c8f2eb1-daca-468f-b34d-654e5ebdefd6 for instance 156e28cf-a566-4a1e-a235-d7715056d589 on hv-cinder-80403 Sep 07 13:26:08.898037 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-e1b5446b-00a3-453a-89c0-aaaa8b1ddf86 req-48c35342-8f86-4f11-bfee-59b7d87e788a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040672 Sep 07 13:26:08.899919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 513/989] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:26:09.132886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-288a17ef-d716-48c3-8658-307df40a0885 req-3bbd5f8f-f7d7-4b6a-80f5-2abd48d3527c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d15324b-0905-4df2-b15a-3ca152c80714", "name": "network-vif-deleted", "tag": "bb2ed752-fee4-4f33-83b3-bce90421f28f"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:09.148920 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-288a17ef-d716-48c3-8658-307df40a0885 req-3bbd5f8f-f7d7-4b6a-80f5-2abd48d3527c service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.150283 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-288a17ef-d716-48c3-8658-307df40a0885 req-3bbd5f8f-f7d7-4b6a-80f5-2abd48d3527c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.151361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-288a17ef-d716-48c3-8658-307df40a0885 req-3bbd5f8f-f7d7-4b6a-80f5-2abd48d3527c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.174109 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-288a17ef-d716-48c3-8658-307df40a0885 req-3bbd5f8f-f7d7-4b6a-80f5-2abd48d3527c service nova] Creating event network-vif-deleted:bb2ed752-fee4-4f33-83b3-bce90421f28f for instance 4d15324b-0905-4df2-b15a-3ca152c80714 on hv-cinder-80403 Sep 07 13:26:09.182907 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-288a17ef-d716-48c3-8658-307df40a0885 req-3bbd5f8f-f7d7-4b6a-80f5-2abd48d3527c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056188 Sep 07 13:26:09.184034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 477/990] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:09.442645 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:09.443301 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:09.451541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.452045 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.452507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.453441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.453909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.454364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.841870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:09.842689 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:09.849433 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.849998 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.850421 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.851160 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.851630 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.852062 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.879018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:09.891301 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-aff097d9-bb6a-414c-9051-4fb4261aae20 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.455899 Sep 07 13:26:09.892282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 514/991] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:09 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:09.897170 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.898560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.898560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.898560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lazy-loading 'fault' on Instance uuid 4d15324b-0905-4df2-b15a-3ca152c80714 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:26:09.945223 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:09.953807 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e7cbcc41-cd0f-4f3b-9a73-0c10bb2229a5 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1304 microversion: 2.1 time: 0.117471 Sep 07 13:26:09.954361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 478/992] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:09 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:10.579991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:10.582202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:10.589243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.589656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.590100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.590814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.591497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.591941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.594744 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:10.627054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dec60b91-24c1-4043-9a4c-13767be9ba6b tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051444 Sep 07 13:26:10.627677 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 515/993] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Sep 7 13:26:10 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:10.692662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:10.693162 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:10.699636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.700135 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.700579 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.701293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.701755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.702217 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.727745 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:26:10.828480 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d1e8b0fc-7f59-4d18-ac77-02ec41c68917 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 204 len: 0 microversion: 2.20 time: 0.139012 Sep 07 13:26:10.829086 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 479/994] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Sep 7 13:26:10 2022] DELETE /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:26:10.837822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:10.838516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:10.845414 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.845832 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.846305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.846989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.847475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.847916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.917021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:10.917908 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:10.925474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.925946 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.926380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.927128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.927591 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.928008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.041298 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:11.055702 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:11.058165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:11.059707 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5bfd147b-19c8-480c-a09a-79ecf3dcfe45 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.225913 Sep 07 13:26:11.060469 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 516/995] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:26:10 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:26:11.080133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:11.080743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:11.087750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:11.089031 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:11.089478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.090205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:11.090659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:11.091081 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.099166 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:11.108001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a00475df-3847-4d6c-8f93-23431651a164 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1364 microversion: 2.1 time: 0.195774 Sep 07 13:26:11.108619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 480/996] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:10 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:11.126388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:11.126938 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:11.127631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.128165 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lazy-loading 'fault' on Instance uuid 4d15324b-0905-4df2-b15a-3ca152c80714 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:26:11.174246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:11.182079 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a5738daa-22b3-4d03-b64c-5a6631caf398 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1304 microversion: 2.1 time: 0.105778 Sep 07 13:26:11.182700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 517/997] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:11 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:12.088379 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:12.088995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:12.095481 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.095979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.096434 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.097126 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.097585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.098013 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.130676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:12.131340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:12.138051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.138544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.139276 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.139743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.140202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.140630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.299750 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:12.308597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:12.310111 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:12.311318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6ba2bf72-11c3-4729-8bdf-a414f2294ec2 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.227433 Sep 07 13:26:12.311878 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 481/998] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:26:12 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:26:12.316473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:12.317075 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:12.323368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.323819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.324261 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.325024 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.325405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.325836 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.333681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:12.342738 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e8d2ee50-942f-40dd-ba7d-1b583f386b83 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1555 microversion: 2.1 time: 0.216201 Sep 07 13:26:12.343495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 518/999] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:12 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:12.364595 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.365089 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.365526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.365998 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lazy-loading 'fault' on Instance uuid 4d15324b-0905-4df2-b15a-3ca152c80714 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:26:12.367325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:12.367823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:12.375084 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.375893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.376342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.377260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.377495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.378205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.430616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:12.434445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:12.443850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-dc04b015-6f50-407b-a9bf-bf7cf6de2a12 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1304 microversion: 2.1 time: 0.130846 Sep 07 13:26:12.444595 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 482/1000] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:12 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:12.477346 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2492a725-dc33-478a-ab40-617626342305 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113861 Sep 07 13:26:12.477952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 519/1001] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:26:12 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:26:13.337034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:13.337648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:13.345792 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.346293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.346732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.347467 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.347929 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.348353 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.468285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:13.468285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:13.477767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.478258 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.478696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.479794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.480259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.480953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.517195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.517709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.518148 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.518657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lazy-loading 'fault' on Instance uuid 4d15324b-0905-4df2-b15a-3ca152c80714 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:26:13.593787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61664af3f594375ac41c8aa7423627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e99d17eda624e1284d6a01e72deddab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:13.596528 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:13.607889 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:13.608519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-18b0d73a-2e57-47c7-b337-ebcf12bd2cf6 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 200 len: 1304 microversion: 2.1 time: 0.145217 Sep 07 13:26:13.609159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 520/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:13 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:13.609948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:13.611210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-76ca702e-7983-4521-bfda-bd71b109e709 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.278442 Sep 07 13:26:13.615266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-d054b6bb-e279-4ccd-895c-3cf4efeb3481 req-53aab8b3-f55f-4bb6-8f75-b6af3ec39bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156e28cf-a566-4a1e-a235-d7715056d589", "tag": "3c8f2eb1-daca-468f-b34d-654e5ebdefd6"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:13.626323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-d054b6bb-e279-4ccd-895c-3cf4efeb3481 req-53aab8b3-f55f-4bb6-8f75-b6af3ec39bbd service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.626903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-d054b6bb-e279-4ccd-895c-3cf4efeb3481 req-53aab8b3-f55f-4bb6-8f75-b6af3ec39bbd service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.627723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-d054b6bb-e279-4ccd-895c-3cf4efeb3481 req-53aab8b3-f55f-4bb6-8f75-b6af3ec39bbd service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.631588 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 483/1003] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:26:13 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:26:13.639310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-d054b6bb-e279-4ccd-895c-3cf4efeb3481 req-53aab8b3-f55f-4bb6-8f75-b6af3ec39bbd service nova] Creating event network-changed:3c8f2eb1-daca-468f-b34d-654e5ebdefd6 for instance 156e28cf-a566-4a1e-a235-d7715056d589 on hv-cinder-80403 Sep 07 13:26:13.644342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-d054b6bb-e279-4ccd-895c-3cf4efeb3481 req-53aab8b3-f55f-4bb6-8f75-b6af3ec39bbd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033811 Sep 07 13:26:13.644946 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 521/1004] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:14.639115 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:14.640688 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] [instance: 4d15324b-0905-4df2-b15a-3ca152c80714] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:14.646460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:14.647458 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:14.656921 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.657571 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.658118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.658963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.660299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.660790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.661184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.661727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.662305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.663283 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.664053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.664821 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.685012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] HTTP exception thrown: Instance 4d15324b-0905-4df2-b15a-3ca152c80714 could not be found. Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Request method failure captured: Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 HTTP/1.1 Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJvcDwz02vTPHMrwCPiRtMTXE7kuZjsGOPkAoVIyQulMfBWHUznOj6kd9HvYA36_kpo_pf2Ggt4okVtzv5p41N2-IOQ8W9gFDv6Bd_Qlz1FynwLfiAxSE64Bwd5zdvS8Omb3U5mZvy7ZBXUdU0o5ijFgPFXDWBPOZpvWbVyUTTqBXE4 Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 6e99d17eda624e1284d6a01e72deddab Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-VolumesNegativeTest-83972999 Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:26:14.687186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6e99d17eda624e1284d6a01e72deddab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e99d17eda624e1284d6a01e72deddab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e99d17eda624e1284d6a01e72deddab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6e99d17eda624e1284d6a01e72deddab"}]}] Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-VolumesNegativeTest-83972999 Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 6e99d17eda624e1284d6a01e72deddab Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-VolumesNegativeTest-83972999 Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-VolumesNegativeTest-83972999-project Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: a61664af3f594375ac41c8aa7423627f Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-VolumesNegativeTest-83972999-project Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 4d15324b-0905-4df2-b15a-3ca152c80714 could not be found. Sep 07 13:26:14.688991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '4d15324b-0905-4df2-b15a-3ca152c80714'} Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d15324b-0905-4df2-b15a-3ca152c80714 could not be found. Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:14.689951 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d15324b-0905-4df2-b15a-3ca152c80714 could not be found. Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d15324b-0905-4df2-b15a-3ca152c80714 could not be found. Sep 07 13:26:14.692056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:14.694161 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] Returning 404 to user: Instance 4d15324b-0905-4df2-b15a-3ca152c80714 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:14.694762 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a070d9a3-0624-4162-a51c-f28128032369 tempest-VolumesNegativeTest-83972999 tempest-VolumesNegativeTest-83972999-project] 10.222.0.61 "GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714" status: 404 len: 111 microversion: 2.1 time: 0.064800 Sep 07 13:26:14.702000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 484/1005] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:14 2022] GET /compute/v2.1/servers/4d15324b-0905-4df2-b15a-3ca152c80714 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:26:14.954187 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:14.976697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:14.981205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '181c888fbd454f00b049522fdfb4197e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1963d0789945fcbd182b7f2ce64d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:14.984244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c90c321b-70e1-4903-ab6f-9e29032f95b7 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 200 len: 1721 microversion: 2.20 time: 0.347468 Sep 07 13:26:14.995343 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 522/1006] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:26:14 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:26:15.671709 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-317d6c79-68ae-4a5a-acb1-40f7129f3a2a req-bdc1c635-32ed-4988-bf8c-4922d1340e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38430858-246f-449d-9580-9747b3bf22e0", "name": "network-vif-deleted", "tag": "d25ce013-3fdb-4ed2-9267-0c86e2ba62b0"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:15.700585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-317d6c79-68ae-4a5a-acb1-40f7129f3a2a req-bdc1c635-32ed-4988-bf8c-4922d1340e2b service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:15.701626 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-317d6c79-68ae-4a5a-acb1-40f7129f3a2a req-bdc1c635-32ed-4988-bf8c-4922d1340e2b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:15.702545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-317d6c79-68ae-4a5a-acb1-40f7129f3a2a req-bdc1c635-32ed-4988-bf8c-4922d1340e2b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:15.726301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-317d6c79-68ae-4a5a-acb1-40f7129f3a2a req-bdc1c635-32ed-4988-bf8c-4922d1340e2b service nova] Creating event network-vif-deleted:d25ce013-3fdb-4ed2-9267-0c86e2ba62b0 for instance 38430858-246f-449d-9580-9747b3bf22e0 on hv-cinder-80403 Sep 07 13:26:15.744862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-317d6c79-68ae-4a5a-acb1-40f7129f3a2a req-bdc1c635-32ed-4988-bf8c-4922d1340e2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083155 Sep 07 13:26:15.747783 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 485/1007] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:16.027864 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:16.029106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:16.036125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:16.036982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:16.037618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:16.038548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:16.039231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:16.039861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:16.058285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] HTTP exception thrown: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Request method failure captured: Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 HTTP/1.1 Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJmtNZzsvdcXy8Zd2_alqhr6UV_eqHHx2xB3eTYy7L7N3rWxVDs6mxhnAwKGIvvqXHRUnaPpdH_zoH_rsbWOLteT420D0UZrfyzed0iYeZlkvuLOq6HMNteAKPj033tx8Exvd0QJ0MiHz1kr9CCf0rmtb-Wtu4-awob6bRBg-FMwCBs Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:26:16.060264 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f1963d0789945fcbd182b7f2ce64d03"}]}] Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 181c888fbd454f00b049522fdfb4197e Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:16.061935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '38430858-246f-449d-9580-9747b3bf22e0'} Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:16.062814 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:16.064660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:16.069504 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Returning 404 to user: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:16.070428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3e52880c-af9e-41d1-a5cd-b2974e2c5379 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 404 len: 111 microversion: 2.20 time: 0.048308 Sep 07 13:26:16.071067 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 523/1008] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:26:16 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:26:16.082278 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-32d2f4cb-1999-44aa-aff2-714f80fdf2dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '.version_select at 0x7fa3deef7d30>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:16.093729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:16.108782 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-32d2f4cb-1999-44aa-aff2-714f80fdf2dd tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592434175" status: 204 len: 0 microversion: 2.20 time: 0.031728 Sep 07 13:26:16.109262 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 486/1009] 10.222.0.61 () {60 vars in 1259 bytes} [Wed Sep 7 13:26:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592434175 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:26:18.089098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:18.090574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:18.100502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.101393 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.101508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.102138 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.102589 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.103013 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.125827 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] HTTP exception thrown: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Request method failure captured: Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 HTTP/1.1 Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJmtNZzsvdcXy8Zd2_alqhr6UV_eqHHx2xB3eTYy7L7N3rWxVDs6mxhnAwKGIvvqXHRUnaPpdH_zoH_rsbWOLteT420D0UZrfyzed0iYeZlkvuLOq6HMNteAKPj033tx8Exvd0QJ0MiHz1kr9CCf0rmtb-Wtu4-awob6bRBg-FMwCBs Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:26:18.128748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f1963d0789945fcbd182b7f2ce64d03"}]}] Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 181c888fbd454f00b049522fdfb4197e Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.131488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '38430858-246f-449d-9580-9747b3bf22e0'} Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:18.134054 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.145275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.148812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Returning 404 to user: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:18.148812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-39f4c622-6f52-4593-a854-99dd56e8b079 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 404 len: 111 microversion: 2.20 time: 0.049460 Sep 07 13:26:18.148812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 524/1010] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Sep 7 13:26:18 2022] DELETE /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:26:18.149749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:18.150717 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: 38430858-246f-449d-9580-9747b3bf22e0] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:18.158003 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.158499 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.158945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.159697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.160255 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.160668 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.176316 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] HTTP exception thrown: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Request method failure captured: Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 HTTP/1.1 Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJmtNZzsvdcXy8Zd2_alqhr6UV_eqHHx2xB3eTYy7L7N3rWxVDs6mxhnAwKGIvvqXHRUnaPpdH_zoH_rsbWOLteT420D0UZrfyzed0iYeZlkvuLOq6HMNteAKPj033tx8Exvd0QJ0MiHz1kr9CCf0rmtb-Wtu4-awob6bRBg-FMwCBs Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:26:18.177999 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f1963d0789945fcbd182b7f2ce64d03"}]}] Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 181c888fbd454f00b049522fdfb4197e Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.179584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '38430858-246f-449d-9580-9747b3bf22e0'} Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:18.180350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. Sep 07 13:26:18.181930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:18.183972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Returning 404 to user: Instance 38430858-246f-449d-9580-9747b3bf22e0 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:18.183972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2fd6f7b0-ee56-4ea1-8f4f-6b03201c9e36 tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0" status: 404 len: 111 microversion: 2.20 time: 0.040658 Sep 07 13:26:18.183972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 487/1011] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:26:18 2022] GET /compute/v2.1/servers/38430858-246f-449d-9580-9747b3bf22e0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:26:19.348771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:19.348771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:19.355985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.356788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.357441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.358365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.358948 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.359596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.382759 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] HTTP exception thrown: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Request method failure captured: Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 HTTP/1.1 Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJmtNZzsvdcXy8Zd2_alqhr6UV_eqHHx2xB3eTYy7L7N3rWxVDs6mxhnAwKGIvvqXHRUnaPpdH_zoH_rsbWOLteT420D0UZrfyzed0iYeZlkvuLOq6HMNteAKPj033tx8Exvd0QJ0MiHz1kr9CCf0rmtb-Wtu4-awob6bRBg-FMwCBs Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:26:19.384794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f1963d0789945fcbd182b7f2ce64d03"}]}] Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 181c888fbd454f00b049522fdfb4197e Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.387451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'aa967676-e023-44fe-af50-47db2225c4c5'} Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:19.388878 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.391497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.393768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Returning 404 to user: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:19.393768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b21eaa20-1a97-429f-a187-5f84b021049a tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 404 len: 111 microversion: 2.20 time: 0.047459 Sep 07 13:26:19.393768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 525/1012] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Sep 7 13:26:19 2022] DELETE /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:26:19.398149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:19.398861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] [instance: aa967676-e023-44fe-af50-47db2225c4c5] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:19.406840 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.407720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.408405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.409611 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.410440 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.411057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.430424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] HTTP exception thrown: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Request method failure captured: Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 HTTP/1.1 Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJmtNZzsvdcXy8Zd2_alqhr6UV_eqHHx2xB3eTYy7L7N3rWxVDs6mxhnAwKGIvvqXHRUnaPpdH_zoH_rsbWOLteT420D0UZrfyzed0iYeZlkvuLOq6HMNteAKPj033tx8Exvd0QJ0MiHz1kr9CCf0rmtb-Wtu4-awob6bRBg-FMwCBs Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:26:19.432277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f1963d0789945fcbd182b7f2ce64d03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f1963d0789945fcbd182b7f2ce64d03"}]}] Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 3f1963d0789945fcbd182b7f2ce64d03 Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970718389 Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 181c888fbd454f00b049522fdfb4197e Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970718389-project Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.434584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': 'aa967676-e023-44fe-af50-47db2225c4c5'} Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:19.435894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. Sep 07 13:26:19.437449 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:26:19.438731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] Returning 404 to user: Instance aa967676-e023-44fe-af50-47db2225c4c5 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:19.438731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-4c320919-8e09-4052-abb3-8443bf2bb28c tempest-AttachVolumeShelveTestJSON-1970718389 tempest-AttachVolumeShelveTestJSON-1970718389-project] 10.222.0.61 "GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5" status: 404 len: 111 microversion: 2.20 time: 0.040070 Sep 07 13:26:19.438731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 488/1013] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Sep 7 13:26:19 2022] GET /compute/v2.1/servers/aa967676-e023-44fe-af50-47db2225c4c5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:27:09.507257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:09.507844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:09.509978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:09.510637 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=51 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:09.517766 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:09.518275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:09.518714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:09.519440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:09.519891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:09.520309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:09.547154 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4fb6ebc4-240d-4bcb-aa42-c53f8734bd0e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/ips" status: 200 len: 150 microversion: 2.1 time: 0.044087 Sep 07 13:27:09.548178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 526/1014] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:27:09 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:10.970783 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7d9beeb-eb32-499b-a198-5db1b3c6b7b0"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:10.974705 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:10.978488 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:10.979536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=15 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:10.991190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:10.991733 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:10.992183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:10.992952 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:10.993419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:10.993850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:11.545912 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d5b66cc8-9963-4f87-a791-91d3ac2376d8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582575 Sep 07 13:27:11.546880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 489/1015] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:27:10 2022] POST /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:19.520823 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1095108916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-524724481", "security_groups": [{"name": "tempest-secgroup-smoke-1156289928"}], "block_device_mapping_v2": [{"uuid": "ce760ad3-b5db-494f-86aa-1a7fa94d5318", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "162da744-90cb-4ad5-9d57-0be2d76a9630"}]}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:19.543902 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=4 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:19.694785 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] validate_networks() for [('162da744-90cb-4ad5-9d57-0be2d76a9630', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:27:20.146429 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:27:20.146855 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:27:20.147367 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:27:20.147844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:27:20.148507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:27:20.159660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:20.160051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:20.160578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:20.161382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:20.161911 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:20.162414 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:20.188256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:27:20.195700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Getting quotas for user 57896ea1ff2046d282fe47e2a8191676 and project 963b95435fe545bb9e9ff7a1c4490a05. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:27:20.263230 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:27:20.266696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce760ad3-b5db-494f-86aa-1a7fa94d5318',volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:27:20.583536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d207fc97-6575-44a1-9784-c5dcf932ccdb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.067030 Sep 07 13:27:20.584515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 527/1016] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:27:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:27:20.597648 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c23412a0-6f60-4339-b86f-80b059fe0dcb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:20.598544 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c23412a0-6f60-4339-b86f-80b059fe0dcb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:20.666010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c23412a0-6f60-4339-b86f-80b059fe0dcb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:20.673892 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c23412a0-6f60-4339-b86f-80b059fe0dcb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1094 microversion: 2.1 time: 0.081155 Sep 07 13:27:20.674485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 490/1017] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:20 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:21.701087 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:21.701707 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:21.711203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:21.711705 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:21.712153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:21.712867 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:21.713335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:21.713764 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:21.818509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:21.828575 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2d66cd68-adea-4879-8d1a-ff65e450310a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1136 microversion: 2.1 time: 0.132413 Sep 07 13:27:21.844819 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 528/1018] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:21 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1136 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:22.378059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e1bacd1c-361d-49de-add4-f0ca1c78eadb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: .version_select at 0x7fa3deec1160>, body: {"keypair": {"name": "tempest-keypair-1851019193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADALGH0ugfIl3BQElsC2WgIiTcqBhJj5wmUxdL5Wxl66cqSysa02fFQU1q/mpI/Jvx8TOqdSqX5SH4d6/61SZCmPtZayaDdcysXIbO7moZsEzhJrozSlbnt1bUQYdUAOg=="}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:22.384757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:22.398961 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-e1bacd1c-361d-49de-add4-f0ca1c78eadb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:27:22.403954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-e1bacd1c-361d-49de-add4-f0ca1c78eadb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:27:22.428570 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e1bacd1c-361d-49de-add4-f0ca1c78eadb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054328 Sep 07 13:27:22.429176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 491/1019] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:27:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:22.857479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:22.858888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:22.865636 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:22.866251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:22.866791 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:22.867623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:22.868171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:22.868691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:22.937931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:22.947144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-11a9bb48-ea6d-420b-9bbb-d249aecee6bd tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1210 microversion: 2.1 time: 0.094581 Sep 07 13:27:22.947653 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 529/1020] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:22 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:23.971228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:23.971988 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:23.985302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:23.988383 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:23.988932 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:23.994197 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:23.994766 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:23.995675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:24.362901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:24.379388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-79032eda-565c-4139-b587-1c6cc2797b6b tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.405858 Sep 07 13:27:24.379388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 492/1021] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:23 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:24.488728 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1617665161", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f60d918-dbd5-4067-8b15-8a46dcb0e077"}], "security_groups": [{"name": "tempest-securitygroup--996917500"}], "key_name": "tempest-keypair-1851019193", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:24.494749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-a7579b4d-0950-4b0e-847e-57454e91f1ec req-472fbe95-d8ae-4c54-b7f5-76f7e2bb662b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470129b4-4c97-42dc-8fa6-8c0136da5bd1", "tag": "abb84f71-3485-4024-98ab-2c48b34c3aeb"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:24.522607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-a7579b4d-0950-4b0e-847e-57454e91f1ec req-472fbe95-d8ae-4c54-b7f5-76f7e2bb662b service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:24.523189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-a7579b4d-0950-4b0e-847e-57454e91f1ec req-472fbe95-d8ae-4c54-b7f5-76f7e2bb662b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:24.524723 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-a7579b4d-0950-4b0e-847e-57454e91f1ec req-472fbe95-d8ae-4c54-b7f5-76f7e2bb662b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:24.537064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-a7579b4d-0950-4b0e-847e-57454e91f1ec req-472fbe95-d8ae-4c54-b7f5-76f7e2bb662b service nova] Creating event network-changed:abb84f71-3485-4024-98ab-2c48b34c3aeb for instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 on hv-cinder-80403 Sep 07 13:27:24.543050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-a7579b4d-0950-4b0e-847e-57454e91f1ec req-472fbe95-d8ae-4c54-b7f5-76f7e2bb662b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063752 Sep 07 13:27:24.544195 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 530/1022] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:24.619670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] validate_networks() for [('6f60d918-dbd5-4067-8b15-8a46dcb0e077', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:27:25.148447 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:27:25.149629 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:27:25.149787 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:27:25.150207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:27:25.150737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:27:25.162674 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.163232 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.163713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.164450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.164956 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.165361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.184644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:27:25.189617 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:27:25.204272 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:27:25.208138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:27:25.260747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-172597c2-9f1e-480a-a058-d920115bfe65 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.776300 Sep 07 13:27:25.267924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 493/1023] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:27:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:27:25.273659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e38a1729-b79e-4a41-bc0f-cc485d225430 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:25.274349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e38a1729-b79e-4a41-bc0f-cc485d225430 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:25.349546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e38a1729-b79e-4a41-bc0f-cc485d225430 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:25.359719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e38a1729-b79e-4a41-bc0f-cc485d225430 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1242 microversion: 2.1 time: 0.090253 Sep 07 13:27:25.360332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 531/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:25 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:25.396905 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:25.397817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:25.404342 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.404839 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.405271 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.405962 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.406414 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.406837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.557879 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:25.568285 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2a0ef622-a8e8-4bc6-8c39-657a2efe8437 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.175299 Sep 07 13:27:25.569250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 494/1025] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:25 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:26.384240 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:26.385713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:26.397960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.399401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.400223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.401500 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.402993 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.403801 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.485633 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:26.496465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bfddb8a8-779b-4765-99cc-efbce29f36aa tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1294 microversion: 2.1 time: 0.117000 Sep 07 13:27:26.497040 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 532/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:26 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:26.609390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:26.610284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:26.617675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.618295 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.618827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.619666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.620186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.621389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.823636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:26.834954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3fb552da-f3f2-48eb-8018-fd1634c2fd53 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.229674 Sep 07 13:27:26.835825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 495/1027] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:26 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:27.525793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:27.527674 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:27.539602 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:27.540733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:27.541591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:27.543046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:27.544544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:27.545290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:27.658854 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:27.670028 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-acef34de-aca2-4f86-b322-644cdd4dd7b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1300 microversion: 2.1 time: 0.152671 Sep 07 13:27:27.670656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 533/1028] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:27 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1300 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:27.872033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:27.872033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:27.875063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:27.875598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:27.876042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:27.876812 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:27.877390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:27.877905 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:28.064979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:28.081955 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ef853c85-bea9-4385-9e0d-2447d74140eb tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.222812 Sep 07 13:27:28.095955 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 496/1029] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:27 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:28.705903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:28.707692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:28.713922 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:28.714454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:28.714893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:28.715627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:28.716094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:28.716516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:28.884452 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-f977cea9-defa-497f-bcb2-71b191b89b0b req-f4f3e34b-d4d9-421e-b6e6-6c72037d1717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e55399-460a-41a9-bb92-1b60685316d2", "tag": "9b9335c8-2896-46a4-ae45-2fe34bbc42a9"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:28.908817 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:28.909718 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-f977cea9-defa-497f-bcb2-71b191b89b0b req-f4f3e34b-d4d9-421e-b6e6-6c72037d1717 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:28.910209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-f977cea9-defa-497f-bcb2-71b191b89b0b req-f4f3e34b-d4d9-421e-b6e6-6c72037d1717 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:28.910646 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-f977cea9-defa-497f-bcb2-71b191b89b0b req-f4f3e34b-d4d9-421e-b6e6-6c72037d1717 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:28.924930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d2243442-806c-4163-8853-772c3fd46061 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.230572 Sep 07 13:27:28.926749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 534/1030] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:28 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:28.926983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-f977cea9-defa-497f-bcb2-71b191b89b0b req-f4f3e34b-d4d9-421e-b6e6-6c72037d1717 service nova] Creating event network-changed:9b9335c8-2896-46a4-ae45-2fe34bbc42a9 for instance 28e55399-460a-41a9-bb92-1b60685316d2 on hv-cinder-80403 Sep 07 13:27:28.933343 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-f977cea9-defa-497f-bcb2-71b191b89b0b req-f4f3e34b-d4d9-421e-b6e6-6c72037d1717 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064156 Sep 07 13:27:28.933848 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 497/1031] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:29.110989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:29.111676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:29.118166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.118659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.119097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:29.119836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.120290 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.121335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:29.329263 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:29.337570 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-426821a8-3a70-4112-a9b4-c0df2f8be802 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.230420 Sep 07 13:27:29.338198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 535/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:29 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:29.957439 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:29.958372 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:29.966177 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.966665 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.967121 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:29.967845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.968301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.968726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:30.149161 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:30.160474 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f6b0f2cc-2401-435e-9fc5-eed81f940381 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.207174 Sep 07 13:27:30.161353 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 498/1033] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:29 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:30.379517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:30.380107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:30.382530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:30.388778 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:30.389280 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:30.389731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:30.390454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:30.390916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:30.391372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:30.577163 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:30.585438 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c7a8be4b-101f-49d0-b429-344a2b53bb18 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.209728 Sep 07 13:27:30.586198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 536/1034] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:30 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:31.191708 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:31.193207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:31.205428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.206826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.208165 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.209869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.210680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.211458 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.389461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:31.400308 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-20583bb6-91bc-4d30-afaf-7423c166c087 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.212451 Sep 07 13:27:31.400914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 499/1035] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:31 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:31.614663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:31.615578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:31.622465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.623464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.623965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.624882 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.625453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.625974 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.817947 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:31.826392 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-228234cb-0eae-4c27-83ea-8c8490d61ff3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.215798 Sep 07 13:27:31.826970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 537/1036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:31 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:32.423979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:32.424701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:32.442289 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:32.442784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:32.443246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:32.443954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:32.444402 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:32.444822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:32.649428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:32.665130 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-af6e0f11-0d38-4834-af55-a11948907824 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.244698 Sep 07 13:27:32.666100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 500/1037] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:32 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:32.853721 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:32.854506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:32.862175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:32.863405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:32.863923 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:32.864631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:32.865089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:32.865517 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:33.067356 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:33.077237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8633ee8c-1bcc-40ed-8bac-3a8ae5b40b49 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.227554 Sep 07 13:27:33.077833 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 538/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:32 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:33.696426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:33.697277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:33.706423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:33.707153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:33.707725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:33.709060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:33.709625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:33.710149 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:33.898116 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:33.907662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-81061eb3-1666-4e01-a47f-ec4992042981 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.216422 Sep 07 13:27:33.908966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 501/1039] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:33 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:34.102121 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:34.102871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:34.110500 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:34.111002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:34.111481 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:34.112225 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:34.112689 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:34.113125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:34.263559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:34.277400 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6b199e03-b9b1-41dc-b52c-ca57b44fe7a8 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.178271 Sep 07 13:27:34.278382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 539/1040] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:34 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:34.938559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:34.939487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:34.949124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:34.950020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:34.950787 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:34.952787 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:34.953600 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:34.954332 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:35.157051 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:35.169890 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5a4b2d8f-0874-40ed-88c9-d1fb8be32390 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.234987 Sep 07 13:27:35.170571 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 502/1041] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:34 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:35.300738 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:35.301380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:35.308983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:35.309479 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:35.309923 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:35.310634 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:35.311092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:35.311555 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:35.353694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=8 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:35.483198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:35.491970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dca2dd97-70b2-4e42-bcd5-e54322c74906 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.195180 Sep 07 13:27:35.492578 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 540/1042] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:35 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:36.195800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:36.196493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:36.199492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:36.200618 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=12 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:36.208608 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:36.209112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:36.209553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:36.210268 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:36.210737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:36.211284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:36.401973 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:36.414820 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d550b8fb-0167-4a43-b607-5348b9c27406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.223129 Sep 07 13:27:36.415468 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 503/1043] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:36 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:36.521434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:36.522438 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:36.532322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:36.532822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:36.533274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:36.538205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:36.538716 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:36.539198 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:36.709406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:36.723895 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8106e656-e8b6-4dd8-91fe-7cf83e52e3e5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.208643 Sep 07 13:27:36.724502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 541/1044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:36 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:36.977131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-6fd97baa-8333-4ab0-b868-26aca46d79ee req-c4899977-ca96-4308-b2b9-454d9e2912be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e55399-460a-41a9-bb92-1b60685316d2", "name": "network-vif-plugged", "status": "completed", "tag": "9b9335c8-2896-46a4-ae45-2fe34bbc42a9"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:36.988076 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-6fd97baa-8333-4ab0-b868-26aca46d79ee req-c4899977-ca96-4308-b2b9-454d9e2912be service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:36.988563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-6fd97baa-8333-4ab0-b868-26aca46d79ee req-c4899977-ca96-4308-b2b9-454d9e2912be service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:36.989159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-6fd97baa-8333-4ab0-b868-26aca46d79ee req-c4899977-ca96-4308-b2b9-454d9e2912be service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.008881 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-6fd97baa-8333-4ab0-b868-26aca46d79ee req-c4899977-ca96-4308-b2b9-454d9e2912be service nova] Creating event network-vif-plugged:9b9335c8-2896-46a4-ae45-2fe34bbc42a9 for instance 28e55399-460a-41a9-bb92-1b60685316d2 on hv-cinder-80403 Sep 07 13:27:37.018108 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-6fd97baa-8333-4ab0-b868-26aca46d79ee req-c4899977-ca96-4308-b2b9-454d9e2912be service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045940 Sep 07 13:27:37.018967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 504/1045] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:37.452909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:37.453516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:37.459802 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:37.460289 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:37.460799 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.461885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:37.462142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:37.462615 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.617885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:37.625943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-117383a9-7d95-4a14-9402-cc783591d882 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.176831 Sep 07 13:27:37.626525 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 542/1046] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:37 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:37.749263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:37.750012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:37.756695 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:37.757190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:37.757636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.758638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:37.759525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:37.760309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.908992 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:37.916972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-aee16be9-3574-43c6-9af8-e3fa91c48860 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.172693 Sep 07 13:27:37.917583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 505/1047] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:37 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:38.656145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:38.657245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:38.664471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:38.664965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:38.665406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:38.666304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:38.666758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:38.667216 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:38.800983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:38.810627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ac399d11-7667-4326-ac0b-58ada0cebfdf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1367 microversion: 2.1 time: 0.160928 Sep 07 13:27:38.811334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 543/1048] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:38 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:38.943621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:38.944650 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:38.956773 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:38.957655 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:38.958436 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:38.959740 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:38.960586 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:38.961265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:39.046121 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-5a41e65a-4c66-4737-8aad-4a1d0b95f8fc req-42e636aa-4fac-4243-b303-9f04fb4c37b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470129b4-4c97-42dc-8fa6-8c0136da5bd1", "name": "network-vif-plugged", "status": "completed", "tag": "abb84f71-3485-4024-98ab-2c48b34c3aeb"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:39.055691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-5a41e65a-4c66-4737-8aad-4a1d0b95f8fc req-42e636aa-4fac-4243-b303-9f04fb4c37b0 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:39.056095 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-5a41e65a-4c66-4737-8aad-4a1d0b95f8fc req-42e636aa-4fac-4243-b303-9f04fb4c37b0 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:39.056531 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-5a41e65a-4c66-4737-8aad-4a1d0b95f8fc req-42e636aa-4fac-4243-b303-9f04fb4c37b0 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:39.069397 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-5a41e65a-4c66-4737-8aad-4a1d0b95f8fc req-42e636aa-4fac-4243-b303-9f04fb4c37b0 service nova] Creating event network-vif-plugged:abb84f71-3485-4024-98ab-2c48b34c3aeb for instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 on hv-cinder-80403 Sep 07 13:27:39.075262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-5a41e65a-4c66-4737-8aad-4a1d0b95f8fc req-42e636aa-4fac-4243-b303-9f04fb4c37b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Sep 07 13:27:39.075934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 544/1049] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:27:39.148647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:39.156414 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-641fa022-2814-481a-a4f1-41409a79614c tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.219037 Sep 07 13:27:39.156978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 506/1050] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:38 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:39.834530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:39.835375 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:39.837591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:39.845474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:39.845981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:39.846456 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:39.847203 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:39.847671 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:39.848099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:39.999066 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:40.007972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0a1d4b0f-98b7-4583-b34e-c0e1073a5328 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1557 microversion: 2.1 time: 0.177578 Sep 07 13:27:40.008622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 545/1051] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:39 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:40.032843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:40.033909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:40.040913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:40.041404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:40.041840 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:40.042583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:40.043027 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:40.043475 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:40.130720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-08dd6214-77c4-432e-92f9-4d542dc968e8 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101656 Sep 07 13:27:40.131419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 507/1052] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:27:40 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:40.182513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:40.183718 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:40.189940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:40.190443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:40.190919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:40.191678 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:40.192142 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:40.192574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:40.213788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=100 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:40.454846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:40.465364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ff313441-e8ed-42b1-880d-32b9e72063d7 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.288849 Sep 07 13:27:40.465963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 546/1053] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:40 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:41.494642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:41.496522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:41.499597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:41.506843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:41.507573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:41.508182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:41.509378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:41.509870 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:41.510670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:41.811553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:41.828573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9a5068cd-e999-40e3-9d9c-1d4d07d9b7c3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1266 microversion: 2.1 time: 0.338274 Sep 07 13:27:41.841123 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 508/1054] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:41 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:41.900455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-382457a2-38bd-49f5-983c-105bd497d480 req-286667d2-568e-424e-9e37-7b116c071cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e55399-460a-41a9-bb92-1b60685316d2", "tag": "9b9335c8-2896-46a4-ae45-2fe34bbc42a9"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:41.911574 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-382457a2-38bd-49f5-983c-105bd497d480 req-286667d2-568e-424e-9e37-7b116c071cb7 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:41.912055 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-382457a2-38bd-49f5-983c-105bd497d480 req-286667d2-568e-424e-9e37-7b116c071cb7 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:41.912490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-382457a2-38bd-49f5-983c-105bd497d480 req-286667d2-568e-424e-9e37-7b116c071cb7 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:41.924546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-382457a2-38bd-49f5-983c-105bd497d480 req-286667d2-568e-424e-9e37-7b116c071cb7 service nova] Creating event network-changed:9b9335c8-2896-46a4-ae45-2fe34bbc42a9 for instance 28e55399-460a-41a9-bb92-1b60685316d2 on hv-cinder-80403 Sep 07 13:27:41.929913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-382457a2-38bd-49f5-983c-105bd497d480 req-286667d2-568e-424e-9e37-7b116c071cb7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126276 Sep 07 13:27:41.930532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 547/1055] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:42.864099 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:42.866419 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:42.888012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:42.888795 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:42.889572 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:42.890891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:42.891724 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:42.892822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:43.099389 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:43.111990 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fa7eaff6-05e0-41bd-9527-5a92d5a654d3 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1452 microversion: 2.1 time: 0.255034 Sep 07 13:27:43.113000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 509/1056] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:42 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1452 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:43.141978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:43.142766 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:43.149964 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:43.150798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:43.152041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:43.153200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:43.153982 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:43.154499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:43.328498 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:43.340442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-949d02df-934c-4c88-a824-56f63cc8de9d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1452 microversion: 2.1 time: 0.203200 Sep 07 13:27:43.341513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 548/1057] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:43 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:45.401040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-17737bd8-e8db-4f52-84cb-8d49dda5862f req-889e3545-f8e9-4c21-a69b-09c82ee7d376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470129b4-4c97-42dc-8fa6-8c0136da5bd1", "tag": "abb84f71-3485-4024-98ab-2c48b34c3aeb"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:45.411557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-17737bd8-e8db-4f52-84cb-8d49dda5862f req-889e3545-f8e9-4c21-a69b-09c82ee7d376 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:45.412039 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-17737bd8-e8db-4f52-84cb-8d49dda5862f req-889e3545-f8e9-4c21-a69b-09c82ee7d376 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:45.412667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-17737bd8-e8db-4f52-84cb-8d49dda5862f req-889e3545-f8e9-4c21-a69b-09c82ee7d376 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:45.433759 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-17737bd8-e8db-4f52-84cb-8d49dda5862f req-889e3545-f8e9-4c21-a69b-09c82ee7d376 service nova] Creating event network-changed:abb84f71-3485-4024-98ab-2c48b34c3aeb for instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 on hv-cinder-80403 Sep 07 13:27:45.444726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-17737bd8-e8db-4f52-84cb-8d49dda5862f req-889e3545-f8e9-4c21-a69b-09c82ee7d376 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046926 Sep 07 13:27:45.448037 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 510/1058] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:28:29.149926 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:29.150571 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:29.153359 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=7 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:29.154018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=10 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:29.160018 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.160511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.160952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.161660 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.162119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.162565 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.189219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fe6a00e3-affd-46db-99e5-a64761a99fb6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2/ips" status: 200 len: 150 microversion: 2.1 time: 0.043240 Sep 07 13:28:29.189803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 549/1059] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:28:29 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:29.200286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=5 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:29.201026 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=96 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:29.205560 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7d9beeb-eb32-499b-a198-5db1b3c6b7b0"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:29.208005 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:29.216205 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.216691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.217163 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.217877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.218340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.218768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.300443 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Invalid volume: volume b7d9beeb-eb32-499b-a198-5db1b3c6b7b0 is already attached to instances: 156e28cf-a566-4a1e-a235-d7715056d589 Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: POST /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2/os-volume_attachments HTTP/1.1 Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 74 Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:28:29.302167 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {"volumeAttachment": {"volumeId": "b7d9beeb-eb32-499b-a198-5db1b3c6b7b0"}} Sep 07 13:28:29.303871 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Invalid volume: volume b7d9beeb-eb32-499b-a198-5db1b3c6b7b0 is already attached to instances: 156e28cf-a566-4a1e-a235-d7715056d589 Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'server_id': '28e55399-460a-41a9-bb92-1b60685316d2', 'body': {'volumeAttachment': {'volumeId': 'b7d9beeb-eb32-499b-a198-5db1b3c6b7b0'}}} Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b7d9beeb-eb32-499b-a198-5db1b3c6b7b0 is already attached to instances: 156e28cf-a566-4a1e-a235-d7715056d589 Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:29.304784 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b7d9beeb-eb32-499b-a198-5db1b3c6b7b0 is already attached to instances: 156e28cf-a566-4a1e-a235-d7715056d589 Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:29.306068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b7d9beeb-eb32-499b-a198-5db1b3c6b7b0 is already attached to instances: 156e28cf-a566-4a1e-a235-d7715056d589 Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 400 to user: Invalid volume: volume b7d9beeb-eb32-499b-a198-5db1b3c6b7b0 is already attached to instances: 156e28cf-a566-4a1e-a235-d7715056d589 {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-835aaf4e-1fcd-436a-ba8a-82b02e74763a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105126 Sep 07 13:28:29.307426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 511/1060] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:28:29 2022] POST /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:28:29.312536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:29.313034 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:29.319394 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.319890 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.320335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.321038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.321504 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.321936 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.349304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:28:29.425733 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4ece6fd6-44c0-4d05-99c7-f1fe56de3720 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 204 len: 0 microversion: 2.1 time: 0.116881 Sep 07 13:28:29.426450 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 550/1061] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:28:29 2022] DELETE /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:28:29.437047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:29.437690 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:29.444529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.445016 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.445451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.446157 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:29.446609 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:29.447031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:29.580309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:29.588155 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-16d05ae5-4d73-4347-ae8e-abd8c6090ec0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1682 microversion: 2.1 time: 0.155179 Sep 07 13:28:29.588719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 512/1062] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:29 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:30.613160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:30.613888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:30.620437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:30.621433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:30.621880 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:30.622576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:30.623199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:30.623487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:30.761916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:30.769666 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e2364d2e-4a1c-4409-91b7-ff1770b1256d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1682 microversion: 2.1 time: 0.160750 Sep 07 13:28:30.770235 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 551/1063] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:30 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:31.793711 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:31.794583 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:31.801548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:31.802043 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:31.802485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:31.803229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:31.803811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:31.804247 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:31.964210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:31.972523 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c12f9074-6df7-4113-afe3-296da71fc634 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1682 microversion: 2.1 time: 0.182627 Sep 07 13:28:31.973104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 513/1064] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:31 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:28:33.000635 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:33.001839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:33.014916 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:33.015435 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:33.015872 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:33.017705 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:33.018051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:33.018486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:33.102847 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:33.111773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f70fecc4-61c7-42b4-a37e-e458bbdbd615 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1615 microversion: 2.1 time: 0.119148 Sep 07 13:28:33.112659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 552/1065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:32 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:33.300705 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-5d72737c-11ee-468c-8af2-288a462e0da0 req-2f5b0dc6-ad15-4858-ac1f-2e1996d7ac34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e55399-460a-41a9-bb92-1b60685316d2", "name": "network-vif-deleted", "tag": "9b9335c8-2896-46a4-ae45-2fe34bbc42a9"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:33.318931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-5d72737c-11ee-468c-8af2-288a462e0da0 req-2f5b0dc6-ad15-4858-ac1f-2e1996d7ac34 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:33.319507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-5d72737c-11ee-468c-8af2-288a462e0da0 req-2f5b0dc6-ad15-4858-ac1f-2e1996d7ac34 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:33.319941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-5d72737c-11ee-468c-8af2-288a462e0da0 req-2f5b0dc6-ad15-4858-ac1f-2e1996d7ac34 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:33.335594 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-5d72737c-11ee-468c-8af2-288a462e0da0 req-2f5b0dc6-ad15-4858-ac1f-2e1996d7ac34 service nova] Creating event network-vif-deleted:9b9335c8-2896-46a4-ae45-2fe34bbc42a9 for instance 28e55399-460a-41a9-bb92-1b60685316d2 on hv-cinder-80403 Sep 07 13:28:33.342866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-5d72737c-11ee-468c-8af2-288a462e0da0 req-2f5b0dc6-ad15-4858-ac1f-2e1996d7ac34 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046962 Sep 07 13:28:33.343634 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 514/1066] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:28:34.136092 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:34.137516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:34.144155 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:34.144720 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:34.145234 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:34.146038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:34.146572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:34.147068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:34.186475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:34.186967 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:34.187425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:34.187875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lazy-loading 'fault' on Instance uuid 28e55399-460a-41a9-bb92-1b60685316d2 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:28:34.236300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:34.243797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c322a2a5-5d2d-442a-91b6-ee8aa0f2136a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 200 len: 1332 microversion: 2.1 time: 0.111529 Sep 07 13:28:34.244381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 553/1067] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:34 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:28:35.269208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:35.269914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:35.277761 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:35.278265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:35.278714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:35.279472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:35.280257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:35.280793 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:35.295778 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 HTTP/1.1 Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:28:35.297461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:28:35.299299 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '28e55399-460a-41a9-bb92-1b60685316d2'} Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:28:35.300229 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:28:35.301661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:28:35.302960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:28:35.302960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cc02c78b-2ad4-45e0-b10e-119e285f7777 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 404 len: 111 microversion: 2.1 time: 0.034276 Sep 07 13:28:35.302960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 515/1068] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:35 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:28:35.312725 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d97cc778-e5fe-4da9-acc9-0815f4bfef38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '.version_select at 0x7fa3db720c10>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:35.320494 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d97cc778-e5fe-4da9-acc9-0815f4bfef38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [8274fed1-2755-47c2-a5c5-cc02ac00267a] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:28:36.332220 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [None req-d97cc778-e5fe-4da9-acc9-0815f4bfef38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [8274fed1-2755-47c2-a5c5-cc02ac00267a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35184. Sep 07 13:28:36.358689 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d97cc778-e5fe-4da9-acc9-0815f4bfef38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851019193" status: 202 len: 0 microversion: 2.1 time: 1.053348 Sep 07 13:28:36.359358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 554/1069] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Sep 7 13:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851019193 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:28:37.232227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:37.232966 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:37.239422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:37.239903 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:37.240340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:37.241044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:37.241482 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:37.241904 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:37.331529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lazy-loading 'services' on Instance uuid 156e28cf-a566-4a1e-a235-d7715056d589 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:28:37.411327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-48a7c831-982d-4047-826a-9f78ed047d8b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments/b7d9beeb-eb32-499b-a198-5db1b3c6b7b0" status: 202 len: 0 microversion: 2.1 time: 0.183222 Sep 07 13:28:37.411916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 516/1070] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:28:37 2022] DELETE /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments/b7d9beeb-eb32-499b-a198-5db1b3c6b7b0 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:28:37.423485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:37.426491 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:37.434761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:37.435645 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:37.436251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:37.437559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:37.438057 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:37.438538 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:37.471365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6bda9162-92aa-4b1f-a6c8-fc275f3f5e33 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053219 Sep 07 13:28:37.471942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 555/1071] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:28:37 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:38.485928 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:38.489243 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:38.496173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:38.496689 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:38.497133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:38.497847 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:38.498305 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:38.498729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:38.532954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3dc7f87e-91f3-42c3-b3e6-d8ffc6ff4c22 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052167 Sep 07 13:28:38.533526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 517/1072] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:28:38 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:28:39.546685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:39.548915 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:39.555502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.555983 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.556422 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.557123 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.557581 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.558643 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.587707 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-079e88d4-61d1-41ff-afe7-691c7df581a6 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045508 Sep 07 13:28:39.588277 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 556/1073] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:28:39 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:28:39.654517 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:39.655087 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:39.662857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.663405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.663855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.664570 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.665030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.665463 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.692298 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:28:39.776486 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6d2a9cdb-81ad-405c-97c9-b9f3aec17c24 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 204 len: 0 microversion: 2.1 time: 0.125211 Sep 07 13:28:39.777919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 518/1074] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:28:39 2022] DELETE /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:28:39.786367 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:39.786981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:39.793840 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.794337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.794782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.795585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.796050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.796478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.936174 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:39.943981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d27abacb-2ea4-4155-8fd0-4d290afcd8c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1679 microversion: 2.1 time: 0.161419 Sep 07 13:28:39.944560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 557/1075] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:39 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:40.968457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:40.969155 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:40.976509 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:40.976987 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:40.977445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:40.978134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:40.978582 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:40.979001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:41.116476 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:41.124410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2b62c16a-6222-47e3-add9-75c2a8e1655c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1679 microversion: 2.1 time: 0.160853 Sep 07 13:28:41.124985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 519/1076] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:40 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:42.148020 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:42.148642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:42.155079 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:42.155591 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:42.156029 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:42.157332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:42.157332 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:42.157582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:42.310229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:42.319511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f766569a-6bac-48ef-8829-e78781b4e40d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1679 microversion: 2.1 time: 0.175231 Sep 07 13:28:42.320094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 558/1077] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:42 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:43.344826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:43.345457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:43.360048 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:43.360550 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:43.360995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:43.361720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:43.362180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:43.362610 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:43.395853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-6b90da1c-acfa-4566-83d3-52af49bdec64 req-e53a6dcc-3e7d-4453-907e-be8dc3cd0377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156e28cf-a566-4a1e-a235-d7715056d589", "name": "network-vif-deleted", "tag": "3c8f2eb1-daca-468f-b34d-654e5ebdefd6"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:43.410336 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b90da1c-acfa-4566-83d3-52af49bdec64 req-e53a6dcc-3e7d-4453-907e-be8dc3cd0377 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:43.410826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b90da1c-acfa-4566-83d3-52af49bdec64 req-e53a6dcc-3e7d-4453-907e-be8dc3cd0377 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:43.411302 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-6b90da1c-acfa-4566-83d3-52af49bdec64 req-e53a6dcc-3e7d-4453-907e-be8dc3cd0377 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:43.424598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-6b90da1c-acfa-4566-83d3-52af49bdec64 req-e53a6dcc-3e7d-4453-907e-be8dc3cd0377 service nova] Creating event network-vif-deleted:3c8f2eb1-daca-468f-b34d-654e5ebdefd6 for instance 156e28cf-a566-4a1e-a235-d7715056d589 on hv-cinder-80403 Sep 07 13:28:43.431844 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-6b90da1c-acfa-4566-83d3-52af49bdec64 req-e53a6dcc-3e7d-4453-907e-be8dc3cd0377 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037829 Sep 07 13:28:43.432984 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 559/1078] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:28:43.467308 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:43.477584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fba269fd-a424-456a-a706-51e47ccf3695 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 200 len: 1614 microversion: 2.1 time: 0.136924 Sep 07 13:28:43.478722 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 520/1079] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:43 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 1614 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:44.502402 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:44.503125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:44.509834 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:44.510325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:44.510767 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:44.511499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:44.511959 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:44.512395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:44.525924 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 HTTP/1.1 Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:28:44.528161 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:28:44.530315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '156e28cf-a566-4a1e-a235-d7715056d589'} Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:28:44.531141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:28:44.532577 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:28:44.534257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:28:44.534257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-96228340-a4a2-43a7-9e5f-87275b0507dc tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 404 len: 111 microversion: 2.1 time: 0.031428 Sep 07 13:28:44.534257 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 560/1080] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:44 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:44.539190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-eedaeeac-7221-411c-8945-e58852263e4c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '.version_select at 0x7fa3def2b790>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:44.559226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-eedaeeac-7221-411c-8945-e58852263e4c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408190779" status: 202 len: 0 microversion: 2.1 time: 0.023790 Sep 07 13:28:44.559893 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 521/1081] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Sep 7 13:28:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408190779 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:28:45.214096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-19ca15a6-645e-46ec-80df-bb81430a8c27 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: .version_select at 0x7fa3db644430>, body: {"keypair": {"name": "tempest-keypair-976381153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3zqZFb4w8f3msaaiIGxek5Q+ydfSwZWNLe4ENjE9CfGHwXgNMOaDTEgkGKjmybxo2L4dEdJfx6/GkrbP1aTixT920LnjyLEqo39xRZctCMaqOBdgghAjSMyF+kCBCNVw=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:45.229719 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-19ca15a6-645e-46ec-80df-bb81430a8c27 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:28:45.234128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-19ca15a6-645e-46ec-80df-bb81430a8c27 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:28:45.257100 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-19ca15a6-645e-46ec-80df-bb81430a8c27 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046926 Sep 07 13:28:45.257634 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 561/1082] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:28:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:46.520401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2039825959", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f60d918-dbd5-4067-8b15-8a46dcb0e077"}], "security_groups": [{"name": "tempest-securitygroup--1185387812"}], "key_name": "tempest-keypair-976381153", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:46.638375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] validate_networks() for [('6f60d918-dbd5-4067-8b15-8a46dcb0e077', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:28:47.055808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:28:47.056233 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:28:47.056709 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:28:47.057125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:28:47.057538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:28:47.067068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.067587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.068025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:47.068765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.069223 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.069670 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:47.086925 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:28:47.090947 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:28:47.102363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:28:47.104794 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:28:47.153910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6e88d328-58fb-4972-ab6d-f66753a4e88e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637801 Sep 07 13:28:47.154737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 522/1083] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:28:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:28:47.166159 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a9e8eb3c-1763-47ad-8f69-8abb03c06d71 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:47.166797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a9e8eb3c-1763-47ad-8f69-8abb03c06d71 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:47.223434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a9e8eb3c-1763-47ad-8f69-8abb03c06d71 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:47.232637 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a9e8eb3c-1763-47ad-8f69-8abb03c06d71 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1241 microversion: 2.1 time: 0.069005 Sep 07 13:28:47.236854 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 562/1084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:47 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:48.254931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:48.255590 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:48.265230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:48.265230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:48.265230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:48.265230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:48.265896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:48.265896 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:48.337493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:48.345569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-42beae13-8b82-42ac-a17c-c6d661170186 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1293 microversion: 2.1 time: 0.094583 Sep 07 13:28:48.346147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 523/1085] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:48 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:49.369382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:49.369968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:49.376480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:49.376963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:49.377397 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:49.378099 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:49.378546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:49.378965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:49.828371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:49.836482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3c514193-ad1a-4b5a-a995-fc1c879f606f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.470988 Sep 07 13:28:49.837070 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 563/1086] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:49 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:50.226740 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-0fb81270-8b4b-4373-bdb5-b2ff08a656b5 req-ae59893e-7e80-4e16-bde7-92573d9d6a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd31a8a-51f5-4827-ad24-a38b3ea69668", "tag": "a72065d4-aa4b-42a0-92be-25fc5d91fbd4"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:50.239128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-0fb81270-8b4b-4373-bdb5-b2ff08a656b5 req-ae59893e-7e80-4e16-bde7-92573d9d6a28 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:50.239771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-0fb81270-8b4b-4373-bdb5-b2ff08a656b5 req-ae59893e-7e80-4e16-bde7-92573d9d6a28 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:50.240284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-0fb81270-8b4b-4373-bdb5-b2ff08a656b5 req-ae59893e-7e80-4e16-bde7-92573d9d6a28 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:50.252094 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-0fb81270-8b4b-4373-bdb5-b2ff08a656b5 req-ae59893e-7e80-4e16-bde7-92573d9d6a28 service nova] Creating event network-changed:a72065d4-aa4b-42a0-92be-25fc5d91fbd4 for instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 on hv-cinder-80403 Sep 07 13:28:50.257666 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-0fb81270-8b4b-4373-bdb5-b2ff08a656b5 req-ae59893e-7e80-4e16-bde7-92573d9d6a28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 Sep 07 13:28:50.258438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 524/1087] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:50.860080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:50.860642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:50.866945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:50.867453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:50.867885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:50.868572 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:50.869025 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:50.869443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:51.017625 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:51.025859 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6ba7ed86-822b-4081-8564-e71f4641afaf tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.169913 Sep 07 13:28:51.026443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 564/1088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:50 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:52.051913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:52.052602 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:52.061558 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:52.062049 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:52.062477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:52.063221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:52.063875 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:52.064292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:52.212980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:52.222342 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-35e31abf-2554-4913-a011-02c369b1a406 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.175655 Sep 07 13:28:52.223315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 525/1089] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:52 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:53.245418 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:53.246027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:53.252529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:53.253014 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:53.253451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:53.254149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:53.254598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:53.255021 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:53.385599 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:53.393253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-12f83368-1179-4ef0-a023-c7de84134518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.151692 Sep 07 13:28:53.393813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 565/1090] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:53 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:54.420164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:54.420901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:54.429336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:54.429936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:54.430471 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:54.431258 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:54.431723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:54.432159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:54.578311 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:54.586643 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a7e02b1a-8fb8-4c7c-bf29-2b62dc5429d4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.172441 Sep 07 13:28:54.587460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 526/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:54 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:55.609885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:55.610490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:55.617205 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:55.617726 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:55.618162 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:55.618868 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:55.619472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:55.619963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:55.765698 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:55.775845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-32c2f262-58fb-4c30-a9ef-d8af7402feb7 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.170206 Sep 07 13:28:55.776554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 566/1092] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:55 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:56.465695 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-33e85079-9088-4c6c-8a57-f6621ed8ec65 req-adfb8458-370e-4bfd-8d69-f4e5296db2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd31a8a-51f5-4827-ad24-a38b3ea69668", "name": "network-vif-plugged", "status": "completed", "tag": "a72065d4-aa4b-42a0-92be-25fc5d91fbd4"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:56.477294 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-33e85079-9088-4c6c-8a57-f6621ed8ec65 req-adfb8458-370e-4bfd-8d69-f4e5296db2a0 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:56.477781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-33e85079-9088-4c6c-8a57-f6621ed8ec65 req-adfb8458-370e-4bfd-8d69-f4e5296db2a0 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:56.478219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-33e85079-9088-4c6c-8a57-f6621ed8ec65 req-adfb8458-370e-4bfd-8d69-f4e5296db2a0 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:56.492485 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-33e85079-9088-4c6c-8a57-f6621ed8ec65 req-adfb8458-370e-4bfd-8d69-f4e5296db2a0 service nova] Creating event network-vif-plugged:a72065d4-aa4b-42a0-92be-25fc5d91fbd4 for instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 on hv-cinder-80403 Sep 07 13:28:56.497454 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-33e85079-9088-4c6c-8a57-f6621ed8ec65 req-adfb8458-370e-4bfd-8d69-f4e5296db2a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110915 Sep 07 13:28:56.498641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 527/1093] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:56.798482 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:56.799145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:56.805554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:56.806052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:56.806499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:56.807242 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:56.807702 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:56.808133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:56.956208 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:56.964463 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-da7d36bd-952e-4155-a788-26b1dd351ae9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.170358 Sep 07 13:28:56.965036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 567/1094] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:56 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:57.986021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:57.986872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:57.992159 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:57.992781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:58.000514 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:58.001002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:58.001514 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:58.002219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:58.002769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:58.003246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:58.157659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:58.172641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3b92d55d-e123-4ba4-b3ad-09eb79b3c6e3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1367 microversion: 2.1 time: 0.187436 Sep 07 13:28:58.173435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 528/1095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:57 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:59.198706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:59.199776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:59.202543 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=6 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:59.204039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:59.209646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:59.210148 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:59.210582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:59.211341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:59.211804 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:59.212233 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:59.215970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:59.353904 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:59.362761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-87c8c6ec-42e8-4324-832c-a7d9f5dc045a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1558 microversion: 2.1 time: 0.168659 Sep 07 13:28:59.363382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 568/1096] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:59 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:59.386020 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:59.386592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:59.389491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:59.395237 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:59.395719 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:59.396257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:59.396866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:59.397310 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:59.397735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:59.400793 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:59.481310 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-a16ff4d1-08f4-4408-9cd1-79e72fa1c085 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099117 Sep 07 13:28:59.482199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 529/1097] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:28:59 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:00.477933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-9968277c-6f6c-46f4-9f93-c7633ad3399d req-56c5b885-b40f-479c-b589-583105ad4459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd31a8a-51f5-4827-ad24-a38b3ea69668", "tag": "a72065d4-aa4b-42a0-92be-25fc5d91fbd4"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:00.489507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9968277c-6f6c-46f4-9f93-c7633ad3399d req-56c5b885-b40f-479c-b589-583105ad4459 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:00.489998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9968277c-6f6c-46f4-9f93-c7633ad3399d req-56c5b885-b40f-479c-b589-583105ad4459 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:00.490415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-9968277c-6f6c-46f4-9f93-c7633ad3399d req-56c5b885-b40f-479c-b589-583105ad4459 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:00.502465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-9968277c-6f6c-46f4-9f93-c7633ad3399d req-56c5b885-b40f-479c-b589-583105ad4459 service nova] Creating event network-changed:a72065d4-aa4b-42a0-92be-25fc5d91fbd4 for instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 on hv-cinder-80403 Sep 07 13:29:00.507564 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-9968277c-6f6c-46f4-9f93-c7633ad3399d req-56c5b885-b40f-479c-b589-583105ad4459 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034016 Sep 07 13:29:00.508166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 569/1098] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:27.561974 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:27.568085 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:27.568779 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-bdd39d23-6e6d-465b-890c-1563b4e5009a req-19b55a75-e7a1-4f35-a3e6-bc5a5fd92568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470129b4-4c97-42dc-8fa6-8c0136da5bd1", "tag": "abb84f71-3485-4024-98ab-2c48b34c3aeb"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:27.574273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:27.575481 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:27.579984 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:27.580695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=7 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:27.584103 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-bdd39d23-6e6d-465b-890c-1563b4e5009a req-19b55a75-e7a1-4f35-a3e6-bc5a5fd92568 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:27.585313 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-bdd39d23-6e6d-465b-890c-1563b4e5009a req-19b55a75-e7a1-4f35-a3e6-bc5a5fd92568 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:27.585460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:27.585638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-bdd39d23-6e6d-465b-890c-1563b4e5009a req-19b55a75-e7a1-4f35-a3e6-bc5a5fd92568 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:27.586350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:27.587267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:27.588527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:27.589605 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:27.590507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:27.600943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-bdd39d23-6e6d-465b-890c-1563b4e5009a req-19b55a75-e7a1-4f35-a3e6-bc5a5fd92568 service nova] Creating event network-changed:abb84f71-3485-4024-98ab-2c48b34c3aeb for instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 on hv-cinder-80403 Sep 07 13:29:27.606168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-bdd39d23-6e6d-465b-890c-1563b4e5009a req-19b55a75-e7a1-4f35-a3e6-bc5a5fd92568 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041985 Sep 07 13:29:27.607544 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 570/1099] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:27.625398 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:29:27.753014 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ff2afd15-dab6-45c2-81d0-67f87e1244a0 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "DELETE /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 204 len: 0 microversion: 2.1 time: 0.192130 Sep 07 13:29:27.753967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 530/1100] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:27 2022] DELETE /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:29:27.763151 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:27.763863 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:27.770933 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:27.771902 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:27.772134 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:27.773090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:27.773562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:27.773998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:27.923748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:27.932299 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-260c8d29-5dd4-488c-b165-c41df71c4cf6 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1577 microversion: 2.1 time: 0.173312 Sep 07 13:29:27.932906 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 571/1101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:27 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:28.962829 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:28.965118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:28.972369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:28.972859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:28.973468 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:28.974176 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:28.974637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:28.975091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:29.121150 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:29.129723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-671fa7ae-b160-411e-afe9-85b1a9c38fa1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1577 microversion: 2.1 time: 0.171367 Sep 07 13:29:29.130366 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 531/1102] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:28 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:30.154422 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:30.155056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:30.162080 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:30.162659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:30.163163 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:30.163923 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:30.164355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:30.164788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:30.310057 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:30.318016 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0b072df5-5568-4f9d-8eb6-f4119011640a tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1577 microversion: 2.1 time: 0.167976 Sep 07 13:29:30.318603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 572/1103] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:30 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:30.940556 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-1fdf745d-1075-475e-af0a-f60875dcb9c6 req-3f43b51b-9f6e-4198-a522-a8a5e93a2d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470129b4-4c97-42dc-8fa6-8c0136da5bd1", "name": "network-vif-deleted", "tag": "abb84f71-3485-4024-98ab-2c48b34c3aeb"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:30.950499 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1fdf745d-1075-475e-af0a-f60875dcb9c6 req-3f43b51b-9f6e-4198-a522-a8a5e93a2d4c service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:30.951116 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1fdf745d-1075-475e-af0a-f60875dcb9c6 req-3f43b51b-9f6e-4198-a522-a8a5e93a2d4c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:30.951589 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-1fdf745d-1075-475e-af0a-f60875dcb9c6 req-3f43b51b-9f6e-4198-a522-a8a5e93a2d4c service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:30.965805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-1fdf745d-1075-475e-af0a-f60875dcb9c6 req-3f43b51b-9f6e-4198-a522-a8a5e93a2d4c service nova] Creating event network-vif-deleted:abb84f71-3485-4024-98ab-2c48b34c3aeb for instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 on hv-cinder-80403 Sep 07 13:29:30.971569 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-1fdf745d-1075-475e-af0a-f60875dcb9c6 req-3f43b51b-9f6e-4198-a522-a8a5e93a2d4c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100297 Sep 07 13:29:30.972368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 532/1104] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:31.343003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:31.343701 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:31.350172 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:31.350655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:31.351091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:31.351812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:31.352279 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:31.352696 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:31.389657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:31.390363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:31.390934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:31.392036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lazy-loading 'fault' on Instance uuid 470129b4-4c97-42dc-8fa6-8c0136da5bd1 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:29:31.441085 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:31.449063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0d555cda-b6b2-40fa-a5fa-c7886cca0771 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 200 len: 1230 microversion: 2.1 time: 0.110620 Sep 07 13:29:31.449630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 573/1105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:31 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:32.476925 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:32.477723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 470129b4-4c97-42dc-8fa6-8c0136da5bd1] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:32.484917 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:32.485420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:32.485851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:32.486642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:32.487115 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:32.487546 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:32.501292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] HTTP exception thrown: Instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 could not be found. Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Request method failure captured: Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 HTTP/1.1 Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJpcXqNafs-kQSI089kET4Vk7fHWgGQOKvvmoYAn4zHPWqxgmZvOF__NCenUS6SNk2sBN_G7ciF2-YZui6EG-Ho5sejlneFrSPxMw2gXBfX9PVkpRG2jDrQvR-WPnMCYGIRcO1IYhwgFozas0sx6etujbi11rxhBb4sv5dUhAKAUCD0 Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:29:32.502950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/963b95435fe545bb9e9ff7a1c4490a05"}]}] Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 57896ea1ff2046d282fe47e2a8191676 Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 could not be found. Sep 07 13:29:32.504627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '470129b4-4c97-42dc-8fa6-8c0136da5bd1'} Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 could not be found. Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:32.505628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 could not be found. Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 could not be found. Sep 07 13:29:32.507318 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:32.508850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Returning 404 to user: Instance 470129b4-4c97-42dc-8fa6-8c0136da5bd1 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:32.508850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d4c8ecb4-31c6-41ef-9405-909409235e62 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1" status: 404 len: 111 microversion: 2.1 time: 0.034130 Sep 07 13:29:32.508850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 533/1106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:32 2022] GET /compute/v2.1/servers/470129b4-4c97-42dc-8fa6-8c0136da5bd1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:35.868614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:35.869499 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:35.872170 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-6bb71717-e0bc-40dc-a583-89847bc2b8d3 req-b078281c-53db-41b9-b526-824461b8620e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a643bbd7-7da9-4fc5-a154-c46f0c2834f3", "tag": "d24831c0-0afc-4520-8128-ae3c95f534e4"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:35.877485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:35.878219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:35.878980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:35.880371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:35.880931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:35.881522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:35.890368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-6bb71717-e0bc-40dc-a583-89847bc2b8d3 req-b078281c-53db-41b9-b526-824461b8620e service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:35.890995 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-6bb71717-e0bc-40dc-a583-89847bc2b8d3 req-b078281c-53db-41b9-b526-824461b8620e service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:35.891710 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-6bb71717-e0bc-40dc-a583-89847bc2b8d3 req-b078281c-53db-41b9-b526-824461b8620e service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:35.912267 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-6bb71717-e0bc-40dc-a583-89847bc2b8d3 req-b078281c-53db-41b9-b526-824461b8620e service nova] Creating event network-changed:d24831c0-0afc-4520-8128-ae3c95f534e4 for instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 on hv-cinder-80403 Sep 07 13:29:35.921802 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-6bb71717-e0bc-40dc-a583-89847bc2b8d3 req-b078281c-53db-41b9-b526-824461b8620e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055789 Sep 07 13:29:35.923325 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 534/1107] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:35.927475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:29:36.060573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4f9dadb5-f726-4e76-ac63-e37cceb68a2d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 204 len: 0 microversion: 2.1 time: 0.195586 Sep 07 13:29:36.067237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 574/1108] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:35 2022] DELETE /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:29:36.079058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:36.080538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:36.094088 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:36.095009 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:36.095849 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:36.097161 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:36.097962 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:36.098751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:36.330771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:36.343797 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-417b0ac3-9d3d-4a0b-85c3-489062e7c0c1 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1577 microversion: 2.1 time: 0.273817 Sep 07 13:29:36.344684 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 535/1109] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:36 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1577 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:37.383082 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:37.384030 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:37.394835 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:37.395771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:37.396239 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:37.396979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:37.397486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:37.398029 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:37.546133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:37.555418 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bf14153f-4d82-4f2b-abf3-4f133fd46b04 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1577 microversion: 2.1 time: 0.178966 Sep 07 13:29:37.556039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 575/1110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:37 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:38.579543 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:38.580194 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:38.586930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:38.587424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:38.588095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:38.588578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:38.589047 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:38.589472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:38.841903 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:38.850379 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3cbd638b-7ff9-4539-84ed-8e88d2b4cc3d tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1577 microversion: 2.1 time: 0.274833 Sep 07 13:29:38.851001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 536/1111] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:38 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1577 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:29:39.123232 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-63169a5c-bc5f-4ef6-937d-a6b9caa365b7 req-ec0de4d6-2823-4a28-8bc2-e2d33dd9a01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a643bbd7-7da9-4fc5-a154-c46f0c2834f3", "name": "network-vif-deleted", "tag": "d24831c0-0afc-4520-8128-ae3c95f534e4"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:39.135401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-63169a5c-bc5f-4ef6-937d-a6b9caa365b7 req-ec0de4d6-2823-4a28-8bc2-e2d33dd9a01a service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:39.135887 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-63169a5c-bc5f-4ef6-937d-a6b9caa365b7 req-ec0de4d6-2823-4a28-8bc2-e2d33dd9a01a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:39.136325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-63169a5c-bc5f-4ef6-937d-a6b9caa365b7 req-ec0de4d6-2823-4a28-8bc2-e2d33dd9a01a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:39.148682 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-63169a5c-bc5f-4ef6-937d-a6b9caa365b7 req-ec0de4d6-2823-4a28-8bc2-e2d33dd9a01a service nova] Creating event network-vif-deleted:d24831c0-0afc-4520-8128-ae3c95f534e4 for instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 on hv-cinder-80403 Sep 07 13:29:39.155379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-63169a5c-bc5f-4ef6-937d-a6b9caa365b7 req-ec0de4d6-2823-4a28-8bc2-e2d33dd9a01a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035484 Sep 07 13:29:39.156346 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 576/1112] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:39.878551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:39.879444 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:39.893087 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:39.893526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:39.893954 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:39.894656 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:39.895246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:39.895679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:39.931385 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:39.932011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:39.932484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:39.932992 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lazy-loading 'fault' on Instance uuid a643bbd7-7da9-4fc5-a154-c46f0c2834f3 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:29:39.979924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57896ea1ff2046d282fe47e2a8191676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963b95435fe545bb9e9ff7a1c4490a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:39.989111 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-ff4759a4-79e9-45d4-a48c-f13d03f1ae6e tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 200 len: 1230 microversion: 2.1 time: 0.114708 Sep 07 13:29:39.989700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 537/1113] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:39 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:41.013876 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:41.014586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: a643bbd7-7da9-4fc5-a154-c46f0c2834f3] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:41.020825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:41.021303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:41.021739 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:41.022648 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:41.022929 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:41.023306 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:41.037751 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] HTTP exception thrown: Instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 could not be found. Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Request method failure captured: Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 HTTP/1.1 Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJpcXqNafs-kQSI089kET4Vk7fHWgGQOKvvmoYAn4zHPWqxgmZvOF__NCenUS6SNk2sBN_G7ciF2-YZui6EG-Ho5sejlneFrSPxMw2gXBfX9PVkpRG2jDrQvR-WPnMCYGIRcO1IYhwgFozas0sx6etujbi11rxhBb4sv5dUhAKAUCD0 Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:29:41.039461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/963b95435fe545bb9e9ff7a1c4490a05"}]}] Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 57896ea1ff2046d282fe47e2a8191676 Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 could not be found. Sep 07 13:29:41.042731 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'a643bbd7-7da9-4fc5-a154-c46f0c2834f3'} Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 could not be found. Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:41.044260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 could not be found. Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 could not be found. Sep 07 13:29:41.046024 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.048076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Returning 404 to user: Instance a643bbd7-7da9-4fc5-a154-c46f0c2834f3 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:41.048076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7a9678dc-97e8-405f-9b6c-f6ef478dfa56 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3" status: 404 len: 111 microversion: 2.1 time: 0.032221 Sep 07 13:29:41.048076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 577/1114] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:41 2022] GET /compute/v2.1/servers/a643bbd7-7da9-4fc5-a154-c46f0c2834f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:41.532168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:41.535429 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:41.540542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:41.541168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:41.541941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:41.542714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:41.543296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:41.543765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:41.560323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] HTTP exception thrown: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Request method failure captured: Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: DELETE /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 HTTP/1.1 Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJpcXqNafs-kQSI089kET4Vk7fHWgGQOKvvmoYAn4zHPWqxgmZvOF__NCenUS6SNk2sBN_G7ciF2-YZui6EG-Ho5sejlneFrSPxMw2gXBfX9PVkpRG2jDrQvR-WPnMCYGIRcO1IYhwgFozas0sx6etujbi11rxhBb4sv5dUhAKAUCD0 Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:29:41.562030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/963b95435fe545bb9e9ff7a1c4490a05"}]}] Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 57896ea1ff2046d282fe47e2a8191676 Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.568105 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '73983bde-1a9b-4a8b-aa02-2481c6e1d727'} Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:41.569246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.570935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.573000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Returning 404 to user: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:41.573000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8010aa46-6010-455b-9421-368cf5297ed5 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "DELETE /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 404 len: 111 microversion: 2.1 time: 0.035981 Sep 07 13:29:41.573000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 538/1115] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:41 2022] DELETE /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:41.573405 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:41.574008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] [instance: 73983bde-1a9b-4a8b-aa02-2481c6e1d727] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:41.584229 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:41.584903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:41.585511 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:41.586279 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:41.586865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:41.587507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:41.604345 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] HTTP exception thrown: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Request method failure captured: Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 HTTP/1.1 Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJpcXqNafs-kQSI089kET4Vk7fHWgGQOKvvmoYAn4zHPWqxgmZvOF__NCenUS6SNk2sBN_G7ciF2-YZui6EG-Ho5sejlneFrSPxMw2gXBfX9PVkpRG2jDrQvR-WPnMCYGIRcO1IYhwgFozas0sx6etujbi11rxhBb4sv5dUhAKAUCD0 Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:29:41.605909 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/963b95435fe545bb9e9ff7a1c4490a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/963b95435fe545bb9e9ff7a1c4490a05"}]}] Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 963b95435fe545bb9e9ff7a1c4490a05 Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-TestVolumeBootPattern-26226311 Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 57896ea1ff2046d282fe47e2a8191676 Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-TestVolumeBootPattern-26226311-project Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.608158 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '73983bde-1a9b-4a8b-aa02-2481c6e1d727'} Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:41.609762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. Sep 07 13:29:41.611399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:41.613013 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Returning 404 to user: Instance 73983bde-1a9b-4a8b-aa02-2481c6e1d727 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:41.613013 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4f90e265-2569-42ea-b9f8-b2b571436fc9 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727" status: 404 len: 111 microversion: 2.1 time: 0.038553 Sep 07 13:29:41.613013 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 578/1116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:41 2022] GET /compute/v2.1/servers/73983bde-1a9b-4a8b-aa02-2481c6e1d727 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:43.018307 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-886b2af8-f1e0-4b98-b250-e8b9af83b373 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] Calling method '.version_select at 0x7fa3dbb72f70>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:43.047333 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-886b2af8-f1e0-4b98-b250-e8b9af83b373 tempest-TestVolumeBootPattern-26226311 tempest-TestVolumeBootPattern-26226311-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-524724481" status: 202 len: 0 microversion: 2.1 time: 0.033172 Sep 07 13:29:43.047978 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 539/1117] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Sep 7 13:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-524724481 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:29:44.331679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:44.332703 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:44.344103 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:44.344856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:44.345605 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:44.346795 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:44.347622 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:44.348366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:44.381790 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-13e30a5a-28e1-4809-a44b-7a7d62ae3bce tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/ips" status: 200 len: 151 microversion: 2.1 time: 0.057317 Sep 07 13:29:44.382372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 579/1118] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:29:44 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:45.807484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23e86cd0-edf5-4b15-8e3f-29da979d71e4"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:45.810157 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:45.817303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:45.817877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:45.818941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:45.819230 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:45.819752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:45.820183 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:46.162499 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d89ad503-91fd-4c35-a65d-e2c5c93099b5 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359151 Sep 07 13:29:46.163578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 540/1119] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:29:45 2022] POST /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:53.795642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23e86cd0-edf5-4b15-8e3f-29da979d71e4"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:53.797963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:53.804500 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:53.805015 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:53.805416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:53.806104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:53.806562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:53.806986 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:53.886472 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Invalid volume: volume 23e86cd0-edf5-4b15-8e3f-29da979d71e4 is already attached to instances: dfd31a8a-51f5-4827-ad24-a38b3ea69668 Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: POST /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments HTTP/1.1 Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 74 Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:29:53.888177 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {"volumeAttachment": {"volumeId": "23e86cd0-edf5-4b15-8e3f-29da979d71e4"}} Sep 07 13:29:53.889760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Invalid volume: volume 23e86cd0-edf5-4b15-8e3f-29da979d71e4 is already attached to instances: dfd31a8a-51f5-4827-ad24-a38b3ea69668 Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'server_id': 'dfd31a8a-51f5-4827-ad24-a38b3ea69668', 'body': {'volumeAttachment': {'volumeId': '23e86cd0-edf5-4b15-8e3f-29da979d71e4'}}} Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 23e86cd0-edf5-4b15-8e3f-29da979d71e4 is already attached to instances: dfd31a8a-51f5-4827-ad24-a38b3ea69668 Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:53.890547 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 23e86cd0-edf5-4b15-8e3f-29da979d71e4 is already attached to instances: dfd31a8a-51f5-4827-ad24-a38b3ea69668 Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:53.891807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 23e86cd0-edf5-4b15-8e3f-29da979d71e4 is already attached to instances: dfd31a8a-51f5-4827-ad24-a38b3ea69668 Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 400 to user: Invalid volume: volume 23e86cd0-edf5-4b15-8e3f-29da979d71e4 is already attached to instances: dfd31a8a-51f5-4827-ad24-a38b3ea69668 {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d40fe207-e73a-4576-aff9-195d4e9df895 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098583 Sep 07 13:29:53.893304 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 580/1120] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:29:53 2022] POST /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:29:53.956319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:53.956898 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:53.963204 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:53.963701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:53.964142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:53.964837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:53.965297 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:53.966260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.050113 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lazy-loading 'services' on Instance uuid dfd31a8a-51f5-4827-ad24-a38b3ea69668 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:29:54.123638 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-87d94235-1cfe-43b8-a087-b21a0f0bc249 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments/23e86cd0-edf5-4b15-8e3f-29da979d71e4" status: 202 len: 0 microversion: 2.1 time: 0.172136 Sep 07 13:29:54.124853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 541/1121] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:29:53 2022] DELETE /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments/23e86cd0-edf5-4b15-8e3f-29da979d71e4 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:29:54.134210 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:54.136407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:54.143695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.144926 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.145370 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.146446 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.146900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.147360 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.178994 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7cfe39a5-a846-41e0-bb64-88ce084f5c15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049654 Sep 07 13:29:54.179533 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 581/1122] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:29:54 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:55.191741 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:55.194089 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:55.201332 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:55.201819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:55.202258 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:55.202953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:55.203448 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:55.203874 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:55.234300 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1471efe4-8008-49e7-b7ba-e9ab675e7de0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047060 Sep 07 13:29:55.234859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 542/1123] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:29:55 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:29:55.301279 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:55.301813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:55.308160 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:55.308641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:55.309077 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:55.309771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:55.310259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:55.310685 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:55.337104 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:29:55.416776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b6487a8a-d350-4fbf-b04d-4556602bb223 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 204 len: 0 microversion: 2.1 time: 0.118876 Sep 07 13:29:55.417561 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 582/1124] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:55 2022] DELETE /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:29:55.426030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:55.426680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:55.433029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:55.433518 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:55.433979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:55.435212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:55.435669 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:55.436095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:55.579011 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:55.587274 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-10108ccc-8620-44f0-a5f6-45afd6010f9f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1683 microversion: 2.1 time: 0.164951 Sep 07 13:29:55.587776 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 543/1125] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:55 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:56.611709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:56.612415 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:56.619988 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:56.620489 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:56.620942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:56.621650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:56.622106 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:56.622534 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:56.765050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:56.772920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-fa95d7c9-b2a6-4720-a48d-d9d54fe2bb1b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1683 microversion: 2.1 time: 0.165550 Sep 07 13:29:56.773589 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 583/1126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:56 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:29:57.799548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:57.800138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:57.802246 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:57.808112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:57.808635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:57.809074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:57.810289 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:57.810742 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:57.811199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:57.814996 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:58.041420 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:58.051601 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-df287619-c762-4fd4-af13-6cb170b3e2ee tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1683 microversion: 2.1 time: 0.257823 Sep 07 13:29:58.052198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 544/1127] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:57 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1683 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:58.745792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-7c60cebd-00a2-49e7-b750-1fe97d14012e req-612fcb1e-75a0-4567-af9d-9b57e2970cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd31a8a-51f5-4827-ad24-a38b3ea69668", "name": "network-vif-deleted", "tag": "a72065d4-aa4b-42a0-92be-25fc5d91fbd4"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:58.753508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:58.761818 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7c60cebd-00a2-49e7-b750-1fe97d14012e req-612fcb1e-75a0-4567-af9d-9b57e2970cb6 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:58.763465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7c60cebd-00a2-49e7-b750-1fe97d14012e req-612fcb1e-75a0-4567-af9d-9b57e2970cb6 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:58.764146 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-7c60cebd-00a2-49e7-b750-1fe97d14012e req-612fcb1e-75a0-4567-af9d-9b57e2970cb6 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:58.774972 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:58.786611 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-7c60cebd-00a2-49e7-b750-1fe97d14012e req-612fcb1e-75a0-4567-af9d-9b57e2970cb6 service nova] Creating event network-vif-deleted:a72065d4-aa4b-42a0-92be-25fc5d91fbd4 for instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 on hv-cinder-80403 Sep 07 13:29:58.793017 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-7c60cebd-00a2-49e7-b750-1fe97d14012e req-612fcb1e-75a0-4567-af9d-9b57e2970cb6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057569 Sep 07 13:29:58.794586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 584/1128] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:59.082573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:59.083832 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:59.090853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:59.091385 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:59.091840 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:59.092573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:59.093032 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:59.093460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:59.130636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:59.130886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:59.131300 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:59.131762 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lazy-loading 'fault' on Instance uuid dfd31a8a-51f5-4827-ad24-a38b3ea69668 {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:29:59.186091 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:59.194469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-eaef109f-b342-482f-b29b-e66d4aa2c9ea tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 200 len: 1331 microversion: 2.1 time: 0.116157 Sep 07 13:29:59.195058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 545/1129] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:59 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:00.219317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:00.219935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:00.227135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:00.227631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:00.228078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:00.228788 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:00.229244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:00.229671 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:00.244598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 HTTP/1.1 Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:30:00.246274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:30:00.248411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'dfd31a8a-51f5-4827-ad24-a38b3ea69668'} Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:30:00.249295 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:30:00.250796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:30:00.252136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:30:00.252136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-af36d7ff-1fe5-489d-8a10-c7e6bd016377 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 404 len: 111 microversion: 2.1 time: 0.033968 Sep 07 13:30:00.252136 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 585/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:00 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:30:00.257513 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2a0ada84-4e4c-4c2f-994f-0a5ddf3b2ff0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '.version_select at 0x7fa3db6701f0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:00.283956 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2a0ada84-4e4c-4c2f-994f-0a5ddf3b2ff0 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976381153" status: 202 len: 0 microversion: 2.1 time: 0.029963 Sep 07 13:30:00.286658 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 546/1131] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Sep 7 13:30:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976381153 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:30:01.026419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0e0e224d-2f85-47db-8a6b-a2db30589639 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: .version_select at 0x7fa3db720160>, body: {"keypair": {"name": "tempest-keypair-1642732182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVJJwy+fkqQXfE1icCy2zRz0IMWA3h1+v+UQi94tZvgwWkCphsdZCxCdnrBASLkhaKjLw5SpEHsJL5wrU5GbvIOR+3pcqaSUKe/Oq/48reAWjgBkIEfPoicbIC+vAAqxg=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:01.043434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-0e0e224d-2f85-47db-8a6b-a2db30589639 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:30:01.047281 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-0e0e224d-2f85-47db-8a6b-a2db30589639 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:30:01.073998 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0e0e224d-2f85-47db-8a6b-a2db30589639 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051421 Sep 07 13:30:01.075125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 586/1132] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:30:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:02.566853 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-44086179", "imageRef": "c905354d-fd05-4a73-b979-9ad273f40f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f60d918-dbd5-4067-8b15-8a46dcb0e077"}], "security_groups": [{"name": "tempest-securitygroup--1347049239"}], "key_name": "tempest-keypair-1642732182", "user_data": "}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:02.683770 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] validate_networks() for [('6f60d918-dbd5-4067-8b15-8a46dcb0e077', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:30:03.104257 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:30:03.104682 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:30:03.105316 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:30:03.106237 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:30:03.107284 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:30:03.117372 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:03.117983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:03.118430 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:03.119198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:03.119659 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:03.120249 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:03.140811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:30:03.145713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Getting quotas for user 1686024a93d34902b19c520d2b2a707d and project 9a188483dd484db4962d038428cba54d. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:30:03.159117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:30:03.161642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c905354d-fd05-4a73-b979-9ad273f40f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:30:03.216637 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-aef76ed1-c562-44eb-86d2-f7f88348f562 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.654645 Sep 07 13:30:03.217330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 547/1133] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:30:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:30:03.228961 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-344df9aa-bed2-4577-b4f2-2023e17c0d15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:03.229690 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-344df9aa-bed2-4577-b4f2-2023e17c0d15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:03.288401 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-344df9aa-bed2-4577-b4f2-2023e17c0d15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:03.296113 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-344df9aa-bed2-4577-b4f2-2023e17c0d15 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1240 microversion: 2.1 time: 0.071553 Sep 07 13:30:03.296692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 587/1134] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:03 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:04.319986 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3aa3968b-83e7-47ff-9c6f-7604f811454a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:04.320983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3aa3968b-83e7-47ff-9c6f-7604f811454a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:04.378491 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3aa3968b-83e7-47ff-9c6f-7604f811454a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:04.385765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3aa3968b-83e7-47ff-9c6f-7604f811454a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1240 microversion: 2.1 time: 0.070825 Sep 07 13:30:04.386360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 548/1135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:04 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:05.408635 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-dd16e4b1-d17d-4edd-a694-1ad998f768c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:05.409279 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-dd16e4b1-d17d-4edd-a694-1ad998f768c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:05.469994 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-dd16e4b1-d17d-4edd-a694-1ad998f768c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:05.479316 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-dd16e4b1-d17d-4edd-a694-1ad998f768c1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1240 microversion: 2.1 time: 0.074311 Sep 07 13:30:05.480000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 588/1136] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:05 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:06.502575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:06.503171 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:06.510422 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:06.510919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:06.511392 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:06.512619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:06.513076 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:06.513506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:06.576758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:06.584958 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-523ab9b0-97da-4bfe-a196-de1709e4cb09 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1244 microversion: 2.1 time: 0.086259 Sep 07 13:30:06.585545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 549/1137] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:06 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:07.609212 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:07.611031 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:07.617945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:07.618776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:07.618860 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:07.619605 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:07.620047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:07.620476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:07.684038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:07.691713 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-60f07421-edde-47f4-8d97-4aa6b4ed0419 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1298 microversion: 2.1 time: 0.087240 Sep 07 13:30:07.692464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 589/1138] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:07 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:08.725278 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:08.726196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:08.734249 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:08.734743 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:08.735206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:08.735922 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:08.736382 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:08.736832 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:08.933368 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:08.944329 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-455239dc-ac8d-4e5d-9a0f-bfda10815a38 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1366 microversion: 2.1 time: 0.225703 Sep 07 13:30:08.944907 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 550/1139] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:08 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:09.236000 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-170f3d21-7c7f-458f-801b-8334ec738840 req-47236c50-7b71-4546-8a79-a46e222eb482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a4e3f2-c362-4ccf-a690-e03fab282a5d", "tag": "d620d45a-a697-4768-baaf-c8f4cc7f0d25"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:09.248798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-170f3d21-7c7f-458f-801b-8334ec738840 req-47236c50-7b71-4546-8a79-a46e222eb482 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:09.249214 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-170f3d21-7c7f-458f-801b-8334ec738840 req-47236c50-7b71-4546-8a79-a46e222eb482 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:09.249644 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-170f3d21-7c7f-458f-801b-8334ec738840 req-47236c50-7b71-4546-8a79-a46e222eb482 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:09.261350 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-170f3d21-7c7f-458f-801b-8334ec738840 req-47236c50-7b71-4546-8a79-a46e222eb482 service nova] Creating event network-changed:d620d45a-a697-4768-baaf-c8f4cc7f0d25 for instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d on hv-cinder-80403 Sep 07 13:30:09.267423 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-170f3d21-7c7f-458f-801b-8334ec738840 req-47236c50-7b71-4546-8a79-a46e222eb482 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036669 Sep 07 13:30:09.268039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 590/1140] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:30:09.968426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:09.969427 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:09.975678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:09.976172 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:09.976617 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:09.977313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:09.977772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:09.978199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:10.114846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:10.123121 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-88e7c0c9-0cbf-42be-a06d-d2cced03913e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1366 microversion: 2.1 time: 0.158782 Sep 07 13:30:10.123676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 551/1141] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:09 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:11.146447 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:11.147097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:11.154687 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:11.155201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:11.155646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:11.156365 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:11.156824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:11.157253 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:11.429639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:11.437568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-149e9ec7-6f72-4d2e-a8c1-8f84732afa87 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1366 microversion: 2.1 time: 0.295491 Sep 07 13:30:11.438152 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 591/1142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:11 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:12.460726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:12.461264 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:12.468551 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:12.469038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:12.469476 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:12.470186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:12.470634 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:12.471061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:12.602755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:12.611459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cc640b29-1d7f-4a4a-8d6b-5c3228f546d9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1366 microversion: 2.1 time: 0.154689 Sep 07 13:30:12.612188 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 552/1143] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:12 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:13.635051 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:13.635838 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:13.643324 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:13.643825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:13.644522 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:13.645398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:13.646615 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:13.647076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:13.813424 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:13.821861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9fdd0dea-5c2e-4954-adf6-4d60d49f7546 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1366 microversion: 2.1 time: 0.190923 Sep 07 13:30:13.822437 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 592/1144] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:13 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:14.789059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:14.790710 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=8 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:14.798378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-a5877e8f-08e5-4ea3-9de8-0ba90f87dc63 req-4ec4c0d1-bd87-44c4-862b-e8e0b41859dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a4e3f2-c362-4ccf-a690-e03fab282a5d", "name": "network-vif-plugged", "status": "completed", "tag": "d620d45a-a697-4768-baaf-c8f4cc7f0d25"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:14.820606 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a5877e8f-08e5-4ea3-9de8-0ba90f87dc63 req-4ec4c0d1-bd87-44c4-862b-e8e0b41859dd service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:14.821493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a5877e8f-08e5-4ea3-9de8-0ba90f87dc63 req-4ec4c0d1-bd87-44c4-862b-e8e0b41859dd service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:14.822302 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-a5877e8f-08e5-4ea3-9de8-0ba90f87dc63 req-4ec4c0d1-bd87-44c4-862b-e8e0b41859dd service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:14.842400 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-a5877e8f-08e5-4ea3-9de8-0ba90f87dc63 req-4ec4c0d1-bd87-44c4-862b-e8e0b41859dd service nova] Creating event network-vif-plugged:d620d45a-a697-4768-baaf-c8f4cc7f0d25 for instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d on hv-cinder-80403 Sep 07 13:30:14.846561 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:14.847305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:14.852168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-a5877e8f-08e5-4ea3-9de8-0ba90f87dc63 req-4ec4c0d1-bd87-44c4-862b-e8e0b41859dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064456 Sep 07 13:30:14.853059 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 553/1145] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:14.856841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:14.857359 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:14.858327 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:14.858595 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:14.859089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:14.859540 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:15.061319 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:15.078001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-05605488-50a4-484c-af81-8d1cd82659a1 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1366 microversion: 2.1 time: 0.235026 Sep 07 13:30:15.078860 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 593/1146] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:14 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:16.108917 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:16.109664 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:16.116260 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:16.116779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:16.117210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:16.117953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:16.118428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:16.118856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:16.261433 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:16.269897 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f4e176a0-8eed-47f6-a4b5-01c2e2a2a43d tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1366 microversion: 2.1 time: 0.166634 Sep 07 13:30:16.270461 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 554/1147] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:16 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:17.293606 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:17.294246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:17.297076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=8 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:17.303554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:17.304050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:17.304490 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:17.305207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:17.305663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:17.306095 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:17.460420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:17.468821 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-618b0e4b-26a5-40c5-8d67-c103cd99b06f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1557 microversion: 2.1 time: 0.179386 Sep 07 13:30:17.469442 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 594/1148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:17 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:17.492851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:17.493410 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:17.500031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:17.500528 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:17.501037 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:17.501746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:17.502227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:17.502661 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:17.590779 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e6d8f0c3-b8f9-4267-9d46-ac49879f959b tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101591 Sep 07 13:30:17.591416 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 555/1149] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Sep 7 13:30:17 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:18.689686 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-dd4bd448-90e1-4752-b83b-6d1c74b1fb99 req-af682684-53ef-43bd-b864-cccbb177ae3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a4e3f2-c362-4ccf-a690-e03fab282a5d", "tag": "d620d45a-a697-4768-baaf-c8f4cc7f0d25"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:18.705623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-dd4bd448-90e1-4752-b83b-6d1c74b1fb99 req-af682684-53ef-43bd-b864-cccbb177ae3b service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:18.707039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-dd4bd448-90e1-4752-b83b-6d1c74b1fb99 req-af682684-53ef-43bd-b864-cccbb177ae3b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:18.709348 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-dd4bd448-90e1-4752-b83b-6d1c74b1fb99 req-af682684-53ef-43bd-b864-cccbb177ae3b service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:18.732968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-dd4bd448-90e1-4752-b83b-6d1c74b1fb99 req-af682684-53ef-43bd-b864-cccbb177ae3b service nova] Creating event network-changed:d620d45a-a697-4768-baaf-c8f4cc7f0d25 for instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d on hv-cinder-80403 Sep 07 13:30:18.739310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-dd4bd448-90e1-4752-b83b-6d1c74b1fb99 req-af682684-53ef-43bd-b864-cccbb177ae3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053008 Sep 07 13:30:18.740056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 595/1150] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:55.097625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:55.098375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=51 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:55.103323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:55.103809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:55.112681 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:55.113168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:55.113597 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:55.114303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:55.114753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:55.115208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:55.146128 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5bdaead0-2dd5-4700-a549-7697ec79b6f9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/ips" status: 200 len: 151 microversion: 2.1 time: 0.050210 Sep 07 13:30:55.146716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 556/1151] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:30:55 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:56.712223 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:56.712984 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=37 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:56.714693 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:30:56.714831 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Wed Sep 7 13:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments (ip 10.222.0.61) !!! Sep 07 13:30:56.720820 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "454fd1de-0862-4150-bfa9-758a873d46ed"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:56.723323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:56.732341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:56.732827 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:56.733260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:56.733974 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:56.734419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:56.734837 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:57.043526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-781c2a53-f4b0-4219-ac2d-f58c61c25e8f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "POST /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332706 Sep 07 13:30:57.044510 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 596/1152] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:30:56 2022] POST /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:04.752369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:04.752937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:04.759245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:04.759729 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:04.760236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:04.760935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:04.761425 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:04.761855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:04.846027 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lazy-loading 'services' on Instance uuid e8a4e3f2-c362-4ccf-a690-e03fab282a5d {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:31:04.921713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-795b5409-2dca-4f84-be0d-da534a3bcc03 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments/454fd1de-0862-4150-bfa9-758a873d46ed" status: 202 len: 0 microversion: 2.1 time: 0.173067 Sep 07 13:31:04.922749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 557/1153] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:31:04 2022] DELETE /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments/454fd1de-0862-4150-bfa9-758a873d46ed => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:31:04.934656 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:04.937130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:04.944265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:04.944761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:04.945219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:04.945920 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:04.946366 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:04.946787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:04.994446 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-de78b4c1-cd17-47f6-ba91-4d0018306ef3 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067198 Sep 07 13:31:04.995028 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 597/1154] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:31:04 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:06.010057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:06.012473 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:06.019040 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:06.019558 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:06.019985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:06.020721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:06.021280 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:06.021706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:06.055565 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cbc980b4-63ab-45a9-9e6d-c685a1ce2d5c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050669 Sep 07 13:31:06.056143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 558/1155] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:31:06 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:31:06.131457 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:06.132146 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:06.139077 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:06.139599 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:06.140039 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:06.140812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:06.141811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:06.141811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:06.171284 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:31:06.248072 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e442ab3b-ab27-42f4-b445-6a6a795a266c tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 204 len: 0 microversion: 2.1 time: 0.120515 Sep 07 13:31:06.248658 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 598/1156] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:31:06 2022] DELETE /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:31:06.256866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:06.257478 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:06.263748 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:06.264251 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:06.264692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:06.265396 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:06.265887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:06.266393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:06.411844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:06.420635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f789d60b-fd5b-4437-b22d-aa8e7d3cd808 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1682 microversion: 2.1 time: 0.167664 Sep 07 13:31:06.421212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 559/1157] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:06 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:07.445710 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:07.446363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:07.453841 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:07.454328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:07.454768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:07.455507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:07.455960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:07.456389 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:07.602292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:07.610879 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-7f86d2be-9b4d-4eb4-9c37-20230d9a8b2a tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1682 microversion: 2.1 time: 0.169428 Sep 07 13:31:07.611699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 599/1158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:07 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:08.636669 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:08.637282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:08.644130 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:08.644615 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:08.645055 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:08.645765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:08.646221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:08.646651 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:08.809405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:08.817207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2dd3f4dc-f2f8-4576-b5a5-702dcd1268e9 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1682 microversion: 2.1 time: 0.184753 Sep 07 13:31:08.817788 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 560/1159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:08 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:09.688888 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-1414f60a-95bb-47aa-aec6-96713dd8fb33 req-b422fcd2-5e66-48d1-b914-9e622b00aa69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a4e3f2-c362-4ccf-a690-e03fab282a5d", "name": "network-vif-deleted", "tag": "d620d45a-a697-4768-baaf-c8f4cc7f0d25"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:09.700891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-1414f60a-95bb-47aa-aec6-96713dd8fb33 req-b422fcd2-5e66-48d1-b914-9e622b00aa69 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:09.701390 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-1414f60a-95bb-47aa-aec6-96713dd8fb33 req-b422fcd2-5e66-48d1-b914-9e622b00aa69 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:09.701842 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-1414f60a-95bb-47aa-aec6-96713dd8fb33 req-b422fcd2-5e66-48d1-b914-9e622b00aa69 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:09.714861 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-1414f60a-95bb-47aa-aec6-96713dd8fb33 req-b422fcd2-5e66-48d1-b914-9e622b00aa69 service nova] Creating event network-vif-deleted:d620d45a-a697-4768-baaf-c8f4cc7f0d25 for instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d on hv-cinder-80403 Sep 07 13:31:09.720410 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-1414f60a-95bb-47aa-aec6-96713dd8fb33 req-b422fcd2-5e66-48d1-b914-9e622b00aa69 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036028 Sep 07 13:31:09.721023 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 600/1160] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:09.843671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:09.843671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:09.853786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:09.853786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:09.853786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:09.853786 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:09.854306 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:09.854306 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:09.896353 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:09.897133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:09.897726 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:09.898385 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lazy-loading 'fault' on Instance uuid e8a4e3f2-c362-4ccf-a690-e03fab282a5d {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:31:09.950226 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1686024a93d34902b19c520d2b2a707d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a188483dd484db4962d038428cba54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:09.959675 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-62bfb916-4f50-4454-897f-52a7c32bf518 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 200 len: 1330 microversion: 2.1 time: 0.122797 Sep 07 13:31:09.960313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 561/1161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:09 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:10.985404 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:10.986156 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:10.992754 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:10.993330 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:10.993774 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:10.994483 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:10.994940 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:10.995453 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:11.010162 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d HTTP/1.1 Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:31:11.012639 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:11.014420 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'e8a4e3f2-c362-4ccf-a690-e03fab282a5d'} Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:11.015548 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:11.016951 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:11.018322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:11.018322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9255b1b1-1c51-4fdd-938d-5150d6b2588f tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 404 len: 111 microversion: 2.1 time: 0.033936 Sep 07 13:31:11.018322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 601/1162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:10 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:11.025212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bdad2ca7-1615-49d9-a455-7ca55d42d5ec tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '.version_select at 0x7fa3db7b5820>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:11.052851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bdad2ca7-1615-49d9-a455-7ca55d42d5ec tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642732182" status: 202 len: 0 microversion: 2.1 time: 0.032622 Sep 07 13:31:11.053899 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 562/1163] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Sep 7 13:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642732182 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:31:12.848560 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:12.849117 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:12.857337 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:12.857832 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:12.858273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:12.858989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:12.859506 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:12.859944 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:12.873883 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d HTTP/1.1 Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:31:12.875484 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.877238 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'e8a4e3f2-c362-4ccf-a690-e03fab282a5d'} Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:12.878340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.879865 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.881465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:12.881465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-da693d74-dd60-4929-bfdd-8781d1a37c1e tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 404 len: 111 microversion: 2.1 time: 0.032241 Sep 07 13:31:12.881465 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 602/1164] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:31:12 2022] DELETE /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:12.886124 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:12.886731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: e8a4e3f2-c362-4ccf-a690-e03fab282a5d] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:12.893544 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:12.894052 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:12.894957 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:12.895703 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:12.896161 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:12.896592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:12.910426 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d HTTP/1.1 Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:31:12.912148 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.913737 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': 'e8a4e3f2-c362-4ccf-a690-e03fab282a5d'} Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:12.914749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. Sep 07 13:31:12.916365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:12.918378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance e8a4e3f2-c362-4ccf-a690-e03fab282a5d could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:12.918378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b9f373ef-420f-41d9-97ca-900a1b34da05 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d" status: 404 len: 111 microversion: 2.1 time: 0.031856 Sep 07 13:31:12.918378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 563/1165] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:12 2022] GET /compute/v2.1/servers/e8a4e3f2-c362-4ccf-a690-e03fab282a5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:14.059130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:14.059632 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:14.066021 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.066507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.066945 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.067918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.068380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.068815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.083270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 HTTP/1.1 Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:31:14.084845 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.086492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'dfd31a8a-51f5-4827-ad24-a38b3ea69668'} Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:14.087383 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.088668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.090603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:14.090603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5101293e-7a02-4b9e-98ba-08ebd4596af4 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 404 len: 111 microversion: 2.1 time: 0.031043 Sep 07 13:31:14.090603 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 603/1166] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:31:14 2022] DELETE /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:14.096173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:14.097005 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: dfd31a8a-51f5-4827-ad24-a38b3ea69668] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:14.104214 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.104760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.105196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.105895 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.106621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.107043 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.121029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 HTTP/1.1 Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:31:14.122566 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.124227 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': 'dfd31a8a-51f5-4827-ad24-a38b3ea69668'} Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:14.125207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. Sep 07 13:31:14.126483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.127808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance dfd31a8a-51f5-4827-ad24-a38b3ea69668 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:14.127808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-927480e9-1649-4d53-b39e-0796690b5b31 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668" status: 404 len: 111 microversion: 2.1 time: 0.032006 Sep 07 13:31:14.127808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 564/1167] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:14 2022] GET /compute/v2.1/servers/dfd31a8a-51f5-4827-ad24-a38b3ea69668 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:14.132623 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:14.133126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:14.140191 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.140681 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.141120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.141942 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.142408 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.142830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.157727 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 HTTP/1.1 Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:31:14.159347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.160928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '28e55399-460a-41a9-bb92-1b60685316d2'} Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:14.164694 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.166209 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.167768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:14.167768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b237416b-b18e-4124-ab52-7c87329817bb tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 404 len: 111 microversion: 2.1 time: 0.032108 Sep 07 13:31:14.167768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 604/1168] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:31:14 2022] DELETE /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:14.169604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:14.170245 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 28e55399-460a-41a9-bb92-1b60685316d2] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:14.176709 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.177195 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.177627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.178319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:14.178790 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:14.179210 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:14.193627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 HTTP/1.1 Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:31:14.195240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.196948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '28e55399-460a-41a9-bb92-1b60685316d2'} Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:14.197826 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. Sep 07 13:31:14.199799 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:14.201031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance 28e55399-460a-41a9-bb92-1b60685316d2 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:14.201031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cf6ac342-e6b5-47d4-9119-3ac63b05d4c2 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2" status: 404 len: 111 microversion: 2.1 time: 0.031100 Sep 07 13:31:14.201031 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 565/1169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:14 2022] GET /compute/v2.1/servers/28e55399-460a-41a9-bb92-1b60685316d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:15.344187 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:15.344761 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:15.351413 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:15.351902 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:15.352339 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:15.353171 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:15.353641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:15.354155 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:15.368646 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 HTTP/1.1 Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:31:15.370526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.372300 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '156e28cf-a566-4a1e-a235-d7715056d589'} Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:15.373380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.374952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.376554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:15.376554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-af4bc606-7a54-4654-9961-e64c13179957 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 404 len: 111 microversion: 2.1 time: 0.031715 Sep 07 13:31:15.376554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 605/1170] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:31:15 2022] DELETE /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:15.380567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:15.381186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] [instance: 156e28cf-a566-4a1e-a235-d7715056d589] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:15.388218 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:15.388698 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:15.389136 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:15.389831 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:15.390287 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:15.390713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:15.405112 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.wsgi [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] HTTP exception thrown: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Request method failure captured: Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: request: GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 HTTP/1.1 Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept: application/json Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Accept-Encoding: identity Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Connection: close Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Length: 0 Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Content-Type: application/json Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Host: 10.222.0.61 Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Openstack-System-Scope: None Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Auth-Token: gAAAAABjGJvjoO_EwVqCAN4x7fgSNt2tEY8HhBgmE-HiFFESGA07Tb0u-39LJWBBBt7uWIoNeZbFZeQbTm3JLYbgBcCD0v7Ui-BTC6lUdaBxARqlrJk2S120zKc1Ye_R8YyZkZDq1hvHXh3NlWP8jrN_xoa9muuxfCKDgIKLjFDl4Z3G5yNLYT8 Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Id: None Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Domain-Name: None Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Identity-Status: Confirmed Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Is-Admin-Project: True Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Id: default Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Domain-Name: Default Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Role: reader,member Sep 07 13:31:15.406678 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Roles: reader,member Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a188483dd484db4962d038428cba54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a188483dd484db4962d038428cba54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a188483dd484db4962d038428cba54d"}]}] Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Id: 9a188483dd484db4962d038428cba54d Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826727642 Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Id: default Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Domain-Name: Default Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Id: 1686024a93d34902b19c520d2b2a707d Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: X-User-Name: tempest-AttachVolumeNegativeTest-1826727642-project Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: method: > Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: exception: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.408324 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: action_args: {'id': '156e28cf-a566-4a1e-a235-d7715056d589'} Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:15.409369 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. Sep 07 13:31:15.410857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR nova.api.openstack.wsgi Sep 07 13:31:15.412291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] Returning 404 to user: Instance 156e28cf-a566-4a1e-a235-d7715056d589 could not be found. {{(pid=121070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:15.412291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-7ac9c50c-f8dc-44df-8db2-bb6230008759 tempest-AttachVolumeNegativeTest-1826727642 tempest-AttachVolumeNegativeTest-1826727642-project] 10.222.0.61 "GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589" status: 404 len: 111 microversion: 2.1 time: 0.031437 Sep 07 13:31:15.412291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 566/1171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:15 2022] GET /compute/v2.1/servers/156e28cf-a566-4a1e-a235-d7715056d589 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:20.219090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c148e76f-0d6e-4636-8def-ca1e0ccbd1a5 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Action: 'create', calling method: .version_select at 0x7fa3db7e6e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-159793157", "metadata": {"Type": "work"}}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:20.516700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c148e76f-0d6e-4636-8def-ca1e0ccbd1a5 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.427370 Sep 07 13:31:20.517357 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 606/1172] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Sep 7 13:31:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 429 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:31:20.530198 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9279096f-7c36-4fb2-ab3a-2d8400224db7 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Calling method '.version_select at 0x7fa3dba81af0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:20.582591 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9279096f-7c36-4fb2-ab3a-2d8400224db7 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a" status: 200 len: 352 microversion: 2.1 time: 0.056210 Sep 07 13:31:20.583174 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 567/1173] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:31:20 2022] GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:21.597613 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-56b4f3b1-57ce-4fe6-b00c-9cc305d00106 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Calling method '.version_select at 0x7fa3db8690d0>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:21.650487 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-56b4f3b1-57ce-4fe6-b00c-9cc305d00106 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a" status: 200 len: 353 microversion: 2.1 time: 0.057549 Sep 07 13:31:21.651130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 607/1174] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:31:21 2022] GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:21.665241 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-330ddbfa-ef46-4287-87b8-b07587835e47 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Calling method '.version_select at 0x7fa3db670ca0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:21.713927 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-330ddbfa-ef46-4287-87b8-b07587835e47 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a" status: 200 len: 353 microversion: 2.1 time: 0.052983 Sep 07 13:31:21.714492 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 568/1175] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:31:21 2022] GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:21.733147 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e0541eea-724d-4679-9aad-49cf9405abde tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Calling method '.version_select at 0x7fa3db807790>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:21.796780 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e0541eea-724d-4679-9aad-49cf9405abde tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a" status: 202 len: 0 microversion: 2.1 time: 0.067647 Sep 07 13:31:21.797451 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 608/1176] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Sep 7 13:31:21 2022] DELETE /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:31:21.805526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0cd94764-3b83-45f5-bf82-ff3119bf3cdc tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Calling method '.version_select at 0x7fa3db7b51f0>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:21.854716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0cd94764-3b83-45f5-bf82-ff3119bf3cdc tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a" status: 200 len: 352 microversion: 2.1 time: 0.053060 Sep 07 13:31:21.855362 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 569/1177] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:31:21 2022] GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:22.869953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f6f1ce2c-8790-40bc-9e32-2e776b6634c1 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Calling method '.version_select at 0x7fa3db8c4e50>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:22.899562 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-f6f1ce2c-8790-40bc-9e32-2e776b6634c1 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] HTTP exception thrown: Volume 3447a5e9-b60a-4e3a-b00f-cc218cea434a could not be found. Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f6f1ce2c-8790-40bc-9e32-2e776b6634c1 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Request method failure captured: Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a HTTP/1.1 Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJ0oibJ7-TSOV66iGBsFErMrxGs4SLVePYFkUYGZv44f94LZnpnchhicN95KiZGMFu34ISL7FCwLpuv32Luc5L-Zz5uZE1nE7uKX4TkW0yuA4D-5rfJtaOCD8qRPKMYC8Y4jMOViRXfZPSpXI0JzhrcVcK5YsDqUcNbiCf3dTH3yjrw Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 1443ef4f8c5d4ad6ba64eeb812882f20 Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-VolumesGetTestJSON-775447883 Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:31:22.902270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1443ef4f8c5d4ad6ba64eeb812882f20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1443ef4f8c5d4ad6ba64eeb812882f20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1443ef4f8c5d4ad6ba64eeb812882f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1443ef4f8c5d4ad6ba64eeb812882f20"}]}] Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-VolumesGetTestJSON-775447883 Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 1443ef4f8c5d4ad6ba64eeb812882f20 Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-VolumesGetTestJSON-775447883 Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-VolumesGetTestJSON-775447883-project Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: b3e7f8f93d744a29bf085b5f5ab476cb Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-VolumesGetTestJSON-775447883-project Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Volume 3447a5e9-b60a-4e3a-b00f-cc218cea434a could not be found. Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': '3447a5e9-b60a-4e3a-b00f-cc218cea434a'} Sep 07 13:31:22.904002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3447a5e9-b60a-4e3a-b00f-cc218cea434a could not be found. (HTTP 404) (Request-ID: req-9f0ecdc6-04c3-47ee-ba89-75fea00bf739) Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:22.905090 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:31:22.906650 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3447a5e9-b60a-4e3a-b00f-cc218cea434a could not be found. Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:31:22.908283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3447a5e9-b60a-4e3a-b00f-cc218cea434a could not be found. Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3447a5e9-b60a-4e3a-b00f-cc218cea434a could not be found. Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f6f1ce2c-8790-40bc-9e32-2e776b6634c1 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] Returning 404 to user: Volume 3447a5e9-b60a-4e3a-b00f-cc218cea434a could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f6f1ce2c-8790-40bc-9e32-2e776b6634c1 tempest-VolumesGetTestJSON-775447883 tempest-VolumesGetTestJSON-775447883-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a" status: 404 len: 109 microversion: 2.1 time: 0.038334 Sep 07 13:31:22.909903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 609/1178] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Sep 7 13:31:22 2022] GET /compute/v2.1/os-volumes/3447a5e9-b60a-4e3a-b00f-cc218cea434a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:32:35.349855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:35.350599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:35.356872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-bb9f52ee-9e4a-4041-8e08-469407d6ab91 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Action: 'create', calling method: .version_select at 0x7fa3db7b53a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-678040328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ2YEq7V96XpkA/inqAzJGUwGi4V6uk4XuLLZ2lF/2AhoiXqkyrrfUnCURZ3WkUthiekMbQS5OkW0WczE6+oavuxYE87SX4apIe1ex3QqWGjFdB9xTpqib7nVguL8J4Dw=="}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:35.377998 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-bb9f52ee-9e4a-4041-8e08-469407d6ab91 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Getting quotas for project 46a7c70b6e6c4ed4bc4445900d2ab03a. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:32:35.384146 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-bb9f52ee-9e4a-4041-8e08-469407d6ab91 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Getting quotas for user 5a28efffb7b041c5b8ee0fbbc850c483 and project 46a7c70b6e6c4ed4bc4445900d2ab03a. Resources: {'key_pairs'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:32:35.413902 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-bb9f52ee-9e4a-4041-8e08-469407d6ab91 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065726 Sep 07 13:32:35.415252 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 570/1179] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:32:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:32:35.489549 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:35.490630 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:35.497519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-886958445", "imageRef": "c49c80b8-f44c-4670-aba9-d0e1c57a734c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-678040328", "networks": [{"uuid": "81aa81c8-97a0-460a-8ee2-4cfa57440f33"}]}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:35.692094 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.network.neutron [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] validate_networks() for [('81aa81c8-97a0-460a-8ee2-4cfa57440f33', None, None, None, None, None)] {{(pid=121069) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:32:36.398737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Flavor limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:32:36.399211 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Image limits 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:32:36.400164 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Flavor pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:32:36.400600 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Image pref 0:0:0 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:32:36.401036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.virt.hardware [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:32:36.420495 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:36.420928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:36.421377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:36.422797 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:36.423371 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:36.423811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:36.450720 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Getting quotas for project 46a7c70b6e6c4ed4bc4445900d2ab03a. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:32:36.455829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Getting quotas for user 5a28efffb7b041c5b8ee0fbbc850c483 and project 46a7c70b6e6c4ed4bc4445900d2ab03a. Resources: {'cores', 'instances', 'ram'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:32:36.469262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Going to run 1 instances... {{(pid=121069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:32:36.472050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c49c80b8-f44c-4670-aba9-d0e1c57a734c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:32:36.528747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-04fe4ba3-4da4-4719-8b53-e0d2cfbfa3e0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042954 Sep 07 13:32:36.529941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 610/1180] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:32:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:32:36.542471 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f963bdb2-7101-4aca-8ac1-bdf6a1ff13ba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:36.543173 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f963bdb2-7101-4aca-8ac1-bdf6a1ff13ba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:36.673021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f963bdb2-7101-4aca-8ac1-bdf6a1ff13ba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:36.680676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f963bdb2-7101-4aca-8ac1-bdf6a1ff13ba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1257 microversion: 2.1 time: 0.142775 Sep 07 13:32:36.681209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 571/1181] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:36 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1257 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:37.700676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:32:37.700676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Wed Sep 7 13:32:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 (ip 10.222.0.61) !!! Sep 07 13:32:37.706178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:37.706805 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:37.716027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:37.716736 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:37.717199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:37.717956 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:37.718419 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:37.718851 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:37.788384 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:37.797268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b6d722ce-0440-454e-95c2-ea362864e571 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1309 microversion: 2.1 time: 0.097962 Sep 07 13:32:37.797856 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 611/1182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:37 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:38.825021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:38.826131 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:38.838998 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:38.845584 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:38.846525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:38.847950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:38.848868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:38.849753 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:39.076078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:39.094722 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b084ea95-d5aa-4f93-bc1e-dddd3f6c61bd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.275869 Sep 07 13:32:39.119662 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 572/1183] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:38 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:40.125664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:40.126374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:40.133166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:40.134003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:40.134474 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:40.135256 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:40.135738 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:40.136163 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:40.281219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:40.289842 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c3c1846f-ebe3-4d77-a04d-3547d42d233f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.168213 Sep 07 13:32:40.290423 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 612/1184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:40 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:41.313704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:41.314315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:41.322378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:41.323223 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:41.323863 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:41.324864 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:41.325762 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:41.326206 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:41.509926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:41.526533 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-675b358c-a0b2-4598-be08-2f86f1bc8034 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.215728 Sep 07 13:32:41.527160 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 573/1185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:41 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:42.551642 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:42.552294 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:42.560462 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:42.560953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:42.561556 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:42.562270 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:42.562762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:42.563293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:42.766310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:42.775240 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1e1982da-c86f-4dd5-afdf-9d1d3143641f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.227707 Sep 07 13:32:42.787369 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 613/1186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:42 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:43.799060 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:43.799700 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:43.806220 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:43.806720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:43.807590 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:43.808685 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:43.809151 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:43.809585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:43.964778 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:43.982586 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-d04cdc32-8919-4144-8a8e-98356a2153f2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.186728 Sep 07 13:32:43.983721 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 574/1187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:43 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:32:45.007178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:45.008127 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:45.014891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:45.015519 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:45.016033 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:45.016935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:45.017463 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:45.017977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:45.182891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:45.196342 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-98fe2200-6113-4e7d-8589-d56aeade6cda tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.193363 Sep 07 13:32:45.197891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 614/1188] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:45 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:46.228487 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:46.229037 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:46.236857 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:46.237319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:46.237764 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:46.238503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:46.238950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:46.239403 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:46.376946 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:46.385704 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-115dc667-f342-4098-8d50-9b8dd2de639c tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.161624 Sep 07 13:32:46.386286 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 575/1189] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:46 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:47.375890 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:47.377930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=6 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:47.412432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:47.415241 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:47.418451 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:47.433850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:47.434812 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:47.435469 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:47.436440 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:47.437057 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:47.437772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:47.475079 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-41ddbf9d-bd1f-4a86-af93-e3dde29a70a7 req-9a84cec8-6f0b-4c93-b57f-8ebf3e6dcf09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c1f10b-8bc4-4fc7-8882-d80019794218", "tag": "9fb22446-f461-4b1b-a535-a4212c62d384"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:47.489889 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-41ddbf9d-bd1f-4a86-af93-e3dde29a70a7 req-9a84cec8-6f0b-4c93-b57f-8ebf3e6dcf09 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:47.490480 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-41ddbf9d-bd1f-4a86-af93-e3dde29a70a7 req-9a84cec8-6f0b-4c93-b57f-8ebf3e6dcf09 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:47.490903 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-41ddbf9d-bd1f-4a86-af93-e3dde29a70a7 req-9a84cec8-6f0b-4c93-b57f-8ebf3e6dcf09 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:47.510700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-41ddbf9d-bd1f-4a86-af93-e3dde29a70a7 req-9a84cec8-6f0b-4c93-b57f-8ebf3e6dcf09 service nova] Creating event network-changed:9fb22446-f461-4b1b-a535-a4212c62d384 for instance c6c1f10b-8bc4-4fc7-8882-d80019794218 on hv-cinder-80403 Sep 07 13:32:47.516950 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-41ddbf9d-bd1f-4a86-af93-e3dde29a70a7 req-9a84cec8-6f0b-4c93-b57f-8ebf3e6dcf09 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148006 Sep 07 13:32:47.517649 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 615/1190] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:32:47.675573 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:47.684519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-71f7b72c-05b8-4f64-a04c-9b7d7fee60da tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.279236 Sep 07 13:32:47.685153 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 576/1191] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:47 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:48.711237 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:48.711907 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:48.719754 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:48.720331 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:48.720899 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:48.721641 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:48.722173 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:48.722596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:48.895699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:48.908323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e5a5b4ca-003c-4f40-bf12-8a11c00ddde5 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.202072 Sep 07 13:32:48.908918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 616/1192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:48 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:32:49.937084 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:49.938142 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:49.951418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:49.952343 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:49.953110 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:49.954365 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:49.955052 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:49.955865 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:50.141386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:50.150516 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0c8feeb2-09ca-4fc9-bf95-77e2c563b557 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.221887 Sep 07 13:32:50.151140 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 577/1193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:49 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:51.175246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:51.175870 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:51.183032 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:51.183546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:51.183987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:51.184692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:51.185146 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:51.185570 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:51.325448 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:51.333516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-20efe6ca-6008-4d9d-83ba-75a135cc9f08 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.162836 Sep 07 13:32:51.334091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 617/1194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:51 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:52.357291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:52.358003 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:52.365577 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:52.366000 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:52.366450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:52.367836 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:52.368297 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:52.368902 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:52.515133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:52.523758 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-1b57634c-0e1d-4c00-9388-bfc5c7e65df2 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.171135 Sep 07 13:32:52.524338 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 578/1195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:52 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:53.548425 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:53.549404 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:53.560750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:53.561251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:53.562749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:53.562749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:53.562981 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:53.563273 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:53.686450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-bc4ad2ca-0025-4a91-b67a-7f26255950bb req-ee549111-0d9a-4033-9551-11664a878d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c1f10b-8bc4-4fc7-8882-d80019794218", "name": "network-vif-plugged", "status": "completed", "tag": "9fb22446-f461-4b1b-a535-a4212c62d384"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:53.700778 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-bc4ad2ca-0025-4a91-b67a-7f26255950bb req-ee549111-0d9a-4033-9551-11664a878d32 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:53.701407 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-bc4ad2ca-0025-4a91-b67a-7f26255950bb req-ee549111-0d9a-4033-9551-11664a878d32 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:53.702108 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-bc4ad2ca-0025-4a91-b67a-7f26255950bb req-ee549111-0d9a-4033-9551-11664a878d32 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:53.715552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-bc4ad2ca-0025-4a91-b67a-7f26255950bb req-ee549111-0d9a-4033-9551-11664a878d32 service nova] Creating event network-vif-plugged:9fb22446-f461-4b1b-a535-a4212c62d384 for instance c6c1f10b-8bc4-4fc7-8882-d80019794218 on hv-cinder-80403 Sep 07 13:32:53.720293 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:53.722282 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-bc4ad2ca-0025-4a91-b67a-7f26255950bb req-ee549111-0d9a-4033-9551-11664a878d32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042675 Sep 07 13:32:53.723201 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 579/1196] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:32:53.736407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-3054db7a-228f-46d3-a420-c839d77b8914 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.192579 Sep 07 13:32:53.737559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 618/1197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:53 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:54.762842 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:54.763679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:54.770327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:54.770813 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:54.771303 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:54.772018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:54.772484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:54.772970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:54.919092 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:54.927182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-41460980-6acc-4040-b647-375649529446 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1357 microversion: 2.1 time: 0.169871 Sep 07 13:32:54.927772 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 580/1198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:54 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:32:55.950015 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:55.950654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:55.958573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:55.959069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:55.959540 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:55.960289 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:55.960750 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:55.961178 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.107965 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:56.116182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-da523740-0eb8-4c22-8ca0-d8074c9a51ed tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1547 microversion: 2.1 time: 0.170092 Sep 07 13:32:56.117364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 619/1199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:55 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:56.139180 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:56.139793 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:56.146604 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.147086 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.147575 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.148279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.148739 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.149164 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.284208 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:56.292920 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-36fb3675-cd76-4ef4-974d-6a54d9bf9bba tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1547 microversion: 2.1 time: 0.157658 Sep 07 13:32:56.293519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 581/1200] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:56 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:56.314679 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:56.319598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:56.320364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Searching by: {'deleted': False, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a'} {{(pid=121069) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 13:32:56.327193 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.327667 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.328093 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.328889 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.329374 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.329792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.427355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.multi_cell_list [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121069) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 13:32:56.534676 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-be3df54e-ae06-42ca-a4d9-d500fea09146 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223677 Sep 07 13:32:56.535627 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 620/1201] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Sep 7 13:32:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:32:56.548501 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:32:56.549139 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:56.555980 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.556471 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.556909 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.557621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:56.558072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:56.558504 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:56.698190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:32:56.706025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-353dd2d3-7cec-476f-a79a-23f86e2d92a6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1547 microversion: 2.1 time: 0.161399 Sep 07 13:32:56.706600 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 582/1202] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:32:56 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:32:58.297130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "527b3e03-2d23-48f5-ab95-e50633da9750"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:32:58.299538 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:32:58.306768 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:58.307291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:58.307730 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:58.308433 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:32:58.308884 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:32:58.309306 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:32:58.636605 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-db52dc97-3173-4b04-9f7b-1c1905b3b7a4 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343508 Sep 07 13:32:58.637481 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 621/1203] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Sep 7 13:32:58 2022] POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:06.489645 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:06.490323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:06.492968 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:06.498391 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:06.498869 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:06.499329 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:06.500030 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:06.500477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:06.500891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:06.504683 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=63 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:06.658219 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:06.667036 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e382dfdf-d77d-4180-9518-42a4f2ce1703 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1593 microversion: 2.1 time: 0.181128 Sep 07 13:33:06.667926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 583/1204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:06 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1593 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:08.716521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:08.718102 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:08.719085 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:08.723440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-3993063c-d7d3-4e04-aa48-4530f9b72ae9 req-3408ca67-f637-4be9-9509-4b6c43cd65e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c1f10b-8bc4-4fc7-8882-d80019794218", "tag": "9fb22446-f461-4b1b-a535-a4212c62d384"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:08.738411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-3993063c-d7d3-4e04-aa48-4530f9b72ae9 req-3408ca67-f637-4be9-9509-4b6c43cd65e4 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:08.739049 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-3993063c-d7d3-4e04-aa48-4530f9b72ae9 req-3408ca67-f637-4be9-9509-4b6c43cd65e4 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:08.739689 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-3993063c-d7d3-4e04-aa48-4530f9b72ae9 req-3408ca67-f637-4be9-9509-4b6c43cd65e4 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:08.760364 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-3993063c-d7d3-4e04-aa48-4530f9b72ae9 req-3408ca67-f637-4be9-9509-4b6c43cd65e4 service nova] Creating event network-changed:9fb22446-f461-4b1b-a535-a4212c62d384 for instance c6c1f10b-8bc4-4fc7-8882-d80019794218 on hv-cinder-80403 Sep 07 13:33:08.766492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-3993063c-d7d3-4e04-aa48-4530f9b72ae9 req-3408ca67-f637-4be9-9509-4b6c43cd65e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050821 Sep 07 13:33:08.767520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 622/1205] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:10.378798 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-247429500"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:10.379515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:10.386531 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:10.387215 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:10.387792 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:10.388559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:10.389074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:10.389585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:10.541647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.network.security_group_api [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Adding security group 0edff710-ed00-4003-94b9-dc463aca6109 to port 9fb22446-f461-4b1b-a535-a4212c62d384 Sep 07 13:33:10.899679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5e8263c5-6e32-4471-8b99-7183335bb9b6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/action" status: 202 len: 0 microversion: 2.1 time: 0.524688 Sep 07 13:33:10.900435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 584/1206] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:33:10 2022] POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:33:10.913346 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:10.915154 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-922862f5-5b70-4f04-9e57-275a445cd70a req-f8bab9e1-522b-4421-a2db-cb123f1d93e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c1f10b-8bc4-4fc7-8882-d80019794218", "tag": "9fb22446-f461-4b1b-a535-a4212c62d384"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:10.916381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:10.926936 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:10.927686 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:10.928358 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:10.929259 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:10.929860 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:10.930973 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:10.938919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-922862f5-5b70-4f04-9e57-275a445cd70a req-f8bab9e1-522b-4421-a2db-cb123f1d93e2 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:10.940004 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-922862f5-5b70-4f04-9e57-275a445cd70a req-f8bab9e1-522b-4421-a2db-cb123f1d93e2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:10.940907 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-922862f5-5b70-4f04-9e57-275a445cd70a req-f8bab9e1-522b-4421-a2db-cb123f1d93e2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:10.972549 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-922862f5-5b70-4f04-9e57-275a445cd70a req-f8bab9e1-522b-4421-a2db-cb123f1d93e2 service nova] Creating event network-changed:9fb22446-f461-4b1b-a535-a4212c62d384 for instance c6c1f10b-8bc4-4fc7-8882-d80019794218 on hv-cinder-80403 Sep 07 13:33:10.982181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-922862f5-5b70-4f04-9e57-275a445cd70a req-f8bab9e1-522b-4421-a2db-cb123f1d93e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073173 Sep 07 13:33:10.983714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 585/1207] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:11.231038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:11.241380 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6b1e77f0-5540-4967-aaf7-ff3935a7a5b8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1757 microversion: 2.1 time: 0.335839 Sep 07 13:33:11.242395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 623/1208] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:10 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1757 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:41.549641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=5 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:41.550393 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=11 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:41.555240 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:41.558312 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:41.565644 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.566139 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.566577 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.567327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.567783 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.568204 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.654366 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-cf510d59-1f1f-4c61-ada4-798a557e2468 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/action" status: 202 len: 0 microversion: 2.1 time: 0.106107 Sep 07 13:33:41.655001 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 586/1209] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:33:41 2022] POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:33:41.661793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=4 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:41.663002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=8 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:41.672821 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:41.673963 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:41.687265 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.687760 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.688199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.688912 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:41.689400 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:41.689792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:41.891846 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:41.900559 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-bd21b113-4a9f-4892-af08-128807a7115f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1749 microversion: 2.1 time: 0.240622 Sep 07 13:33:41.901150 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 624/1210] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:41 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1749 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:42.924321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:42.925133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:42.933061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.935424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.935424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:42.935424 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:42.936636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:42.936636 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:43.110755 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:43.119817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-3ae9ff0b-49b9-4c31-a534-d6c911e53ab6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.199694 Sep 07 13:33:43.120652 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 587/1211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:42 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:44.143987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:44.144683 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:44.151743 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.152340 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.152773 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.153478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:44.153925 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:44.154349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:44.322984 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:44.333816 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-13aebb8e-d59d-4346-a445-c84570f3b44d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.193484 Sep 07 13:33:44.334377 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 625/1212] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:44 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:45.360844 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:45.361459 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:45.368522 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:45.369641 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:45.370104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.370831 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:45.371340 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:45.371761 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:45.536359 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:45.546775 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6b0fbe3c-22d8-4100-9657-9a7a05891dc6 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.189829 Sep 07 13:33:45.547388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 588/1213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:45 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:46.569753 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:46.570387 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:46.577132 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.577614 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.578052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.578749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:46.579243 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:46.579668 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:46.725189 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:46.734390 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6f3ee274-7264-4ba0-a9dd-2f19e88f7a2d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.168402 Sep 07 13:33:46.734964 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 626/1214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:46 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:47.757776 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:47.758428 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:47.765186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.765680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.766123 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:47.766833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:47.767323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:47.767748 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:47.915621 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:47.924647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-405820db-ccad-44b0-8e15-d302f079f29d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.170690 Sep 07 13:33:47.925225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 589/1215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:47 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:48.948395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:48.950331 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:48.957372 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:48.957652 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:48.958097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:48.958813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:48.959310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:48.959737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:49.127287 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:49.138153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5fc8cb0f-9c6c-4adc-8ae3-2c0d284ad6cd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.194242 Sep 07 13:33:49.139093 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 627/1216] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:48 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:50.162015 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:50.162757 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:50.169866 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:50.170366 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:50.170807 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.171558 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:50.172017 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:50.172442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:50.348686 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:50.361809 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-99be97e6-eba3-4955-a4d8-3ae6692843de tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.203697 Sep 07 13:33:50.362450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 590/1217] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:50 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:51.387204 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:51.387931 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:51.396454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.397133 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.397675 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.398533 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:51.399219 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:51.399756 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:51.602987 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:51.612202 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-4ccbbd51-37fb-449e-840f-908c3d900e3f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.229805 Sep 07 13:33:51.613071 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 628/1218] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:51 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:52.637924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:52.638716 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:52.645538 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:52.646033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:52.646477 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:52.647221 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:52.647681 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:52.648108 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:52.804134 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:52.816058 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-81b7d6f4-8b91-4fa9-adb5-4ffb05fa0d2a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.182561 Sep 07 13:33:52.816647 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 591/1219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:52 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:53.841540 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:53.842255 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:53.849924 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:53.850406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:53.850840 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:53.851576 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:53.852052 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:53.852478 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:54.047157 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:54.055455 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d6379f57-9ceb-4303-b0d2-64ca1bd61d0a tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.218318 Sep 07 13:33:54.056128 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 629/1220] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:53 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:55.079320 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:55.079981 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:55.087585 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:55.088079 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:55.088515 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:55.089304 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:55.089760 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:55.090273 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:55.278767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:55.288133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-58150c3e-68c8-4b9b-acb6-2394b29bb342 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.212560 Sep 07 13:33:55.288633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 592/1221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:55 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:56.313875 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:56.314539 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:56.321041 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:56.322118 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:56.322654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:56.323440 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:56.323954 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:56.324328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:56.473654 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:56.482695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ab7880cc-50be-4607-9ee8-cd225cba161b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.173830 Sep 07 13:33:56.483315 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 630/1222] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:56 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:57.506548 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:57.507168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:57.514184 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:57.514681 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:57.515143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:57.515850 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:57.516307 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:57.516733 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:57.666945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:57.675467 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-80553d2f-b753-4122-8fe9-9999d36cab3d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.173050 Sep 07 13:33:57.676042 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 593/1223] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:57 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:58.699811 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:58.700434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:58.707168 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:58.707658 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:58.708097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:58.708805 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:58.709274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:58.709680 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:58.864500 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:58.872796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e5be3ccb-eb36-441d-a160-8d8de08a067e tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.177379 Sep 07 13:33:58.876246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 631/1224] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:58 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:59.898833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:59.900199 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:59.906973 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:59.907497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:59.907936 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:59.908633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:59.909092 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:59.909520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:00.086033 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:00.095628 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-2ea7e3da-048c-4930-9c22-50e3f9d3c0df tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.200575 Sep 07 13:34:00.096212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 594/1225] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:59 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:01.119826 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:01.120414 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:01.126725 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:01.127262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:01.127695 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:01.128379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:01.128827 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:01.129248 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:01.280191 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:01.288507 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1f2b796b-7cdd-4776-aed4-771065cd3cfd tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.173083 Sep 07 13:34:01.289097 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 632/1226] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:01 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:02.315360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:02.316447 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:02.327877 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.328663 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.329413 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.330598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:02.331455 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:02.332236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:02.511250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:02.519867 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-9900b800-ffa8-4745-b47a-da3f37e27334 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.211560 Sep 07 13:34:02.520614 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 595/1227] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:02 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:03.544919 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:03.545728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:03.551665 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:03.552153 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:03.552598 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:03.553292 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:03.553748 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:03.554175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:03.723046 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:03.731806 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-0cc10541-6147-44cd-8aad-9740521e2e0b tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1754 microversion: 2.1 time: 0.190949 Sep 07 13:34:03.732393 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 633/1228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:03 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:04.757861 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:04.758734 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:04.766265 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:04.766598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:04.766810 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:04.768189 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:04.768189 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:04.768642 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:04.956038 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:04.967713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-42dc9698-67f1-4b2b-802d-3305cabfe6a3 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1757 microversion: 2.1 time: 0.214466 Sep 07 13:34:04.968791 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 596/1229] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:04 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:43.218260 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-247429500"}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:43.219406 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:43.222824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=20 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:43.223853 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=60 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:43.225122 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 07 13:34:43.234181 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:43.234663 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:43.235120 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:43.235829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:43.236275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:43.236691 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:43.407978 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.network.security_group_api [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Removing security group 0edff710-ed00-4003-94b9-dc463aca6109 from port 9fb22446-f461-4b1b-a535-a4212c62d384 Sep 07 13:34:43.740666 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c149638f-577a-4958-a68c-fa46966cab10 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/action" status: 202 len: 0 microversion: 2.1 time: 0.530513 Sep 07 13:34:43.742069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 634/1230] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:34:43 2022] POST /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:34:43.750527 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-d9662f23-d4a8-4df5-913a-81dad2589d0f req-d3898915-e1fa-45e7-bf95-d9aa75694303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c1f10b-8bc4-4fc7-8882-d80019794218", "tag": "9fb22446-f461-4b1b-a535-a4212c62d384"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:43.760190 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=22 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:43.761003 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:43.765216 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d9662f23-d4a8-4df5-913a-81dad2589d0f req-d3898915-e1fa-45e7-bf95-d9aa75694303 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:43.765749 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d9662f23-d4a8-4df5-913a-81dad2589d0f req-d3898915-e1fa-45e7-bf95-d9aa75694303 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:43.767327 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-d9662f23-d4a8-4df5-913a-81dad2589d0f req-d3898915-e1fa-45e7-bf95-d9aa75694303 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:43.784838 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-d9662f23-d4a8-4df5-913a-81dad2589d0f req-d3898915-e1fa-45e7-bf95-d9aa75694303 service nova] Creating event network-changed:9fb22446-f461-4b1b-a535-a4212c62d384 for instance c6c1f10b-8bc4-4fc7-8882-d80019794218 on hv-cinder-80403 Sep 07 13:34:43.790395 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-d9662f23-d4a8-4df5-913a-81dad2589d0f req-d3898915-e1fa-45e7-bf95-d9aa75694303 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043614 Sep 07 13:34:43.791535 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 597/1231] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:44.855266 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:44.855807 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:44.867251 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.868137 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.868974 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:44.870481 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.871379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.872166 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:44.975309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-04adcc71-d698-4751-b2dc-62799a075c6c req-6d4edd63-4ecb-4502-9dbf-1e7d8010b53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c1f10b-8bc4-4fc7-8882-d80019794218", "tag": "9fb22446-f461-4b1b-a535-a4212c62d384"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:44.975979 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.objects.instance [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lazy-loading 'services' on Instance uuid c6c1f10b-8bc4-4fc7-8882-d80019794218 {{(pid=121069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:34:44.990991 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-04adcc71-d698-4751-b2dc-62799a075c6c req-6d4edd63-4ecb-4502-9dbf-1e7d8010b53a service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.992319 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-04adcc71-d698-4751-b2dc-62799a075c6c req-6d4edd63-4ecb-4502-9dbf-1e7d8010b53a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.993244 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-04adcc71-d698-4751-b2dc-62799a075c6c req-6d4edd63-4ecb-4502-9dbf-1e7d8010b53a service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:45.013147 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-04adcc71-d698-4751-b2dc-62799a075c6c req-6d4edd63-4ecb-4502-9dbf-1e7d8010b53a service nova] Creating event network-changed:9fb22446-f461-4b1b-a535-a4212c62d384 for instance c6c1f10b-8bc4-4fc7-8882-d80019794218 on hv-cinder-80403 Sep 07 13:34:45.021602 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-04adcc71-d698-4751-b2dc-62799a075c6c req-6d4edd63-4ecb-4502-9dbf-1e7d8010b53a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174484 Sep 07 13:34:45.023577 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 598/1232] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:45.084525 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-addbec21-489e-4801-a87c-09a0dd15b9d8 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments/527b3e03-2d23-48f5-ab95-e50633da9750" status: 202 len: 0 microversion: 2.1 time: 0.242821 Sep 07 13:34:45.087501 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 635/1233] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:34:44 2022] DELETE /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments/527b3e03-2d23-48f5-ab95-e50633da9750 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:34:45.096300 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:45.100193 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:45.120918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:45.121530 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:45.121970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:45.124178 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:45.124656 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:45.125093 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:45.162924 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fa08d504-fa4c-4f17-be2a-51656657478d tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072581 Sep 07 13:34:45.164152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 599/1234] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:34:45 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:46.178497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:46.181382 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:46.188607 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.189095 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.189541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.190324 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.190708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.191180 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.224515 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6cca2765-b179-436c-84c2-c1f721c76900 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050469 Sep 07 13:34:46.225119 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 636/1235] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:34:46 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:47.238660 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:47.240835 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:47.247411 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.247901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.248337 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:47.249104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.249587 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.250017 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:47.279570 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-c3e9842a-3d72-4fcc-81c4-64ae7ce612d0 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044824 Sep 07 13:34:47.280137 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 600/1236] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Sep 7 13:34:47 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:34:47.290824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:47.291373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:47.297659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.298144 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.298582 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:47.299317 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.299772 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.300200 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:47.375881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] HTTP exception thrown: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 is not attached to volume 527b3e03-2d23-48f5-ab95-e50633da9750 Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Request method failure captured: Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: DELETE /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments/527b3e03-2d23-48f5-ab95-e50633da9750 HTTP/1.1 Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJ1kXiV_LOqRW60nzoPV-Q5jOBol02aPisM1aSHg66BXB-lySc5MDCkioiJW3ZmgMPoczqe7kawDynMjXx6EukWiypWhpnYP9x7b5cHDYUvV9DQussG1Ug0z_u6b87M8YIvRwnpIC7DYBzS5RruRHkId_OxkJxEbg2zEUFbA85ir5Mc Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 46a7c70b6e6c4ed4bc4445900d2ab03a Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-TestMinimumBasicScenario-627561001 Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:34:47.378275 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_46a7c70b6e6c4ed4bc4445900d2ab03a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/46a7c70b6e6c4ed4bc4445900d2ab03a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/46a7c70b6e6c4ed4bc4445900d2ab03a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/46a7c70b6e6c4ed4bc4445900d2ab03a"}]}] Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-TestMinimumBasicScenario-627561001 Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 46a7c70b6e6c4ed4bc4445900d2ab03a Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-TestMinimumBasicScenario-627561001 Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-TestMinimumBasicScenario-627561001-project Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 5a28efffb7b041c5b8ee0fbbc850c483 Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-TestMinimumBasicScenario-627561001-project Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:34:47.380078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 is not attached to volume 527b3e03-2d23-48f5-ab95-e50633da9750 Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'server_id': 'c6c1f10b-8bc4-4fc7-8882-d80019794218', 'id': '527b3e03-2d23-48f5-ab95-e50633da9750'} Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 527b3e03-2d23-48f5-ab95-e50633da9750. Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:47.380977 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 is not attached to volume 527b3e03-2d23-48f5-ab95-e50633da9750 Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 is not attached to volume 527b3e03-2d23-48f5-ab95-e50633da9750 Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:47.383379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Returning 404 to user: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 is not attached to volume 527b3e03-2d23-48f5-ab95-e50633da9750 {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:47.384631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-5345637c-3cd7-426d-a180-0058b42f3592 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments/527b3e03-2d23-48f5-ab95-e50633da9750" status: 404 len: 154 microversion: 2.1 time: 0.093042 Sep 07 13:34:47.384631 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 637/1237] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Sep 7 13:34:47 2022] DELETE /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218/os-volume_attachments/527b3e03-2d23-48f5-ab95-e50633da9750 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:48.526263 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:48.526769 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:48.533405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.533900 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.534341 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.535044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.535607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.535956 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.563830 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Going to try to terminate instance {{(pid=121070) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:34:48.642735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fa4021ac-9091-4912-8c24-af311a6ed225 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 204 len: 0 microversion: 2.1 time: 0.120641 Sep 07 13:34:48.643916 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 601/1238] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:34:48 2022] DELETE /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:34:48.652812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:48.653530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:48.660388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.660857 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.661285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.661980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.662431 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.662851 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.795428 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:48.803550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1d9c87d2-82c0-496b-9d0a-571567571287 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1553 microversion: 2.1 time: 0.155020 Sep 07 13:34:48.804749 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 638/1239] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:48 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:49.828679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:49.829756 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:49.837846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.838330 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.838767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.839503 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.839953 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.840800 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:50.262013 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:50.272323 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8cd3b61c-e528-41d0-998b-beccd6706b5f tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1553 microversion: 2.1 time: 0.448694 Sep 07 13:34:50.272984 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 602/1240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:49 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1553 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:51.297813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:51.298471 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:51.307079 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:51.307885 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:51.308322 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.309036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:51.309488 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:51.309918 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.407771 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a28efffb7b041c5b8ee0fbbc850c483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a7c70b6e6c4ed4bc4445900d2ab03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:51.428149 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-1ff9f4ab-15cf-4008-b9c6-bf7b0cd50a83 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 200 len: 1511 microversion: 2.1 time: 0.135116 Sep 07 13:34:51.429825 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 639/1241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:51 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 1511 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:51.479938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-7d72149f-fba0-4000-8170-e0da85b51099 req-80b0616a-d4de-4481-ae51-5dac6099a513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c1f10b-8bc4-4fc7-8882-d80019794218", "name": "network-vif-deleted", "tag": "9fb22446-f461-4b1b-a535-a4212c62d384"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:51.494322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-7d72149f-fba0-4000-8170-e0da85b51099 req-80b0616a-d4de-4481-ae51-5dac6099a513 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:51.495046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-7d72149f-fba0-4000-8170-e0da85b51099 req-80b0616a-d4de-4481-ae51-5dac6099a513 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:51.495612 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-7d72149f-fba0-4000-8170-e0da85b51099 req-80b0616a-d4de-4481-ae51-5dac6099a513 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.509478 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-7d72149f-fba0-4000-8170-e0da85b51099 req-80b0616a-d4de-4481-ae51-5dac6099a513 service nova] Creating event network-vif-deleted:9fb22446-f461-4b1b-a535-a4212c62d384 for instance c6c1f10b-8bc4-4fc7-8882-d80019794218 on hv-cinder-80403 Sep 07 13:34:51.516025 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-7d72149f-fba0-4000-8170-e0da85b51099 req-80b0616a-d4de-4481-ae51-5dac6099a513 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043467 Sep 07 13:34:51.516923 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 603/1242] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:52.452145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:52.452709 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] [instance: c6c1f10b-8bc4-4fc7-8882-d80019794218] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:52.459076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.459585 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.460628 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.461328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.461783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.462204 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.476175 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] HTTP exception thrown: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 could not be found. Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Request method failure captured: Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 HTTP/1.1 Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJ1kXiV_LOqRW60nzoPV-Q5jOBol02aPisM1aSHg66BXB-lySc5MDCkioiJW3ZmgMPoczqe7kawDynMjXx6EukWiypWhpnYP9x7b5cHDYUvV9DQussG1Ug0z_u6b87M8YIvRwnpIC7DYBzS5RruRHkId_OxkJxEbg2zEUFbA85ir5Mc Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: 46a7c70b6e6c4ed4bc4445900d2ab03a Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-TestMinimumBasicScenario-627561001 Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:34:52.477728 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_46a7c70b6e6c4ed4bc4445900d2ab03a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/46a7c70b6e6c4ed4bc4445900d2ab03a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/46a7c70b6e6c4ed4bc4445900d2ab03a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/46a7c70b6e6c4ed4bc4445900d2ab03a"}]}] Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-TestMinimumBasicScenario-627561001 Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: 46a7c70b6e6c4ed4bc4445900d2ab03a Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-TestMinimumBasicScenario-627561001 Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-TestMinimumBasicScenario-627561001-project Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 5a28efffb7b041c5b8ee0fbbc850c483 Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-TestMinimumBasicScenario-627561001-project Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 could not be found. Sep 07 13:34:52.479813 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'c6c1f10b-8bc4-4fc7-8882-d80019794218'} Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 could not be found. Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:52.480792 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 could not be found. Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 could not be found. Sep 07 13:34:52.482182 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:34:52.483492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Returning 404 to user: Instance c6c1f10b-8bc4-4fc7-8882-d80019794218 could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:52.483492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-6f7b3da6-48dc-4385-b159-8fc0971a0868 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218" status: 404 len: 111 microversion: 2.1 time: 0.031026 Sep 07 13:34:52.483492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 640/1243] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:52 2022] GET /compute/v2.1/servers/c6c1f10b-8bc4-4fc7-8882-d80019794218 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:52.492923 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-14cd8fcc-ab4b-4235-aadd-39e1dcdf9125 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] Calling method '.version_select at 0x7fa3db7c9430>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:52.516655 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-14cd8fcc-ab4b-4235-aadd-39e1dcdf9125 tempest-TestMinimumBasicScenario-627561001 tempest-TestMinimumBasicScenario-627561001-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-678040328" status: 202 len: 0 microversion: 2.1 time: 0.031203 Sep 07 13:34:52.517250 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 604/1244] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Sep 7 13:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-678040328 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:35:13.351038 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=14 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:13.352326 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:13.596250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-df5f0bcd-5123-4018-a8ed-4a7310f2aa07 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Action: 'create', calling method: .version_select at 0x7fa3db807670>, body: {"keypair": {"name": "tempest-TestShelveInstance-280276680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi3SBrPEwDiigrqBhbMRas1WQSH6PABGMI2Vqb+nohWhgQpCTawnV08znTyl0ccFbkBASlq0GX6kKukUm7Z2volaJw3PDR3k9WRchNkcS7rt+hmLQPBPr+3JNhx0xom9w=="}} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:13.616132 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-df5f0bcd-5123-4018-a8ed-4a7310f2aa07 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Getting quotas for project e4fd5ac76e47431eb9ed60b34784d2e3. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:13.621836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.quota [None req-df5f0bcd-5123-4018-a8ed-4a7310f2aa07 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Getting quotas for user 923df66d00e04d73aab0a82bc671cb13 and project e4fd5ac76e47431eb9ed60b34784d2e3. Resources: {'key_pairs'} {{(pid=121069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:13.653291 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-df5f0bcd-5123-4018-a8ed-4a7310f2aa07 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.308758 Sep 07 13:35:13.654068 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 641/1245] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Sep 7 13:35:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:35:31.315421 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:31.316188 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:31.320196 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1729115637", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-280276680", "security_groups": [{"name": "tempest-secgroup-smoke-1246827114"}], "networks": [{"uuid": "8066b0fd-936e-403f-88d6-c17bda63fbce"}], "block_device_mapping_v2": [{"uuid": "62defaba-cd1b-4c21-bfef-7df9d331b0a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:31.445876 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.network.neutron [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] validate_networks() for [('8066b0fd-936e-403f-88d6-c17bda63fbce', None, None, None, None, None)] {{(pid=121070) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:35:31.934582 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Flavor limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:35:31.935046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Image limits 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:35:31.935557 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Flavor pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:35:31.935967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Image pref 0:0:0 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:35:31.936378 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.virt.hardware [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:35:31.945145 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.945633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.946073 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.946828 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.947320 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.947747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.965507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Getting quotas for project e4fd5ac76e47431eb9ed60b34784d2e3. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:31.969505 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.quota [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Getting quotas for user 923df66d00e04d73aab0a82bc671cb13 and project e4fd5ac76e47431eb9ed60b34784d2e3. Resources: {'cores', 'instances', 'ram'} {{(pid=121070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:32.028883 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Going to run 1 instances... {{(pid=121070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:35:32.031143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62defaba-cd1b-4c21-bfef-7df9d331b0a9',volume_size=None,volume_type=None)] {{(pid=121070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:35:32.164100 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [cc53c0ae-4db8-4ddc-a5a7-6d6faae99b67] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:35:33.173918 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [cc53c0ae-4db8-4ddc-a5a7-6d6faae99b67] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36894. Sep 07 13:35:33.178118 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8f846e80-a19e-49c0-8ddc-75e87c96ad45 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.864207 Sep 07 13:35:33.178795 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 605/1246] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Sep 7 13:35:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:35:33.191036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-b23f705f-db7d-424f-920b-308d7ef23ee3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:33.192091 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-b23f705f-db7d-424f-920b-308d7ef23ee3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:33.195399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=4 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:33.198262 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:33.257098 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-b23f705f-db7d-424f-920b-308d7ef23ee3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:33.265520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-b23f705f-db7d-424f-920b-308d7ef23ee3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1088 microversion: 2.1 time: 0.078654 Sep 07 13:35:33.266102 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 642/1247] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:33 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:34.288635 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:34.289207 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:34.296616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:34.297117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:34.297553 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:34.298361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:34.298832 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:34.299321 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:34.372490 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:34.380807 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-61a842c8-673a-4e78-8557-67d72a64d8f9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1186 microversion: 2.1 time: 0.096488 Sep 07 13:35:34.381406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 606/1248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:34 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:35.406078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:35.407398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:35.415617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.417282 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.418058 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.418946 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.419532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.420280 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.669815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:35.677486 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-a110a467-d7c7-424a-880a-e75f3b162092 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.275483 Sep 07 13:35:35.678088 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 643/1249] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:35 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:36.094116 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-b5073712-7239-474f-97dc-877d0d2f473a req-be68ca40-9f05-410f-a9be-8ed853ed73a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29569fc-b3ba-41c6-bc21-c1f693f31a7e", "tag": "394c1d92-d558-4d59-bfb0-409b1c0168e8"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:36.114862 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b5073712-7239-474f-97dc-877d0d2f473a req-be68ca40-9f05-410f-a9be-8ed853ed73a8 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:36.115983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b5073712-7239-474f-97dc-877d0d2f473a req-be68ca40-9f05-410f-a9be-8ed853ed73a8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:36.116529 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-b5073712-7239-474f-97dc-877d0d2f473a req-be68ca40-9f05-410f-a9be-8ed853ed73a8 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:36.131313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-b5073712-7239-474f-97dc-877d0d2f473a req-be68ca40-9f05-410f-a9be-8ed853ed73a8 service nova] Creating event network-changed:394c1d92-d558-4d59-bfb0-409b1c0168e8 for instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e on hv-cinder-80403 Sep 07 13:35:36.136720 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-b5073712-7239-474f-97dc-877d0d2f473a req-be68ca40-9f05-410f-a9be-8ed853ed73a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051116 Sep 07 13:35:36.137360 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 607/1250] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:36.701858 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:36.702466 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:36.709400 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:36.709925 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:36.710388 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:36.711130 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:36.711594 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:36.712022 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:36.868897 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:36.880002 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e9c381c8-029b-4981-a5d3-c84517964e1f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.181660 Sep 07 13:35:36.881468 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 644/1251] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:36 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:37.922381 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:37.923738 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:37.936352 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.937235 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.938046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.939339 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.940181 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.940983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.093371 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:38.101409 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e1bb52ab-d6b7-451f-8516-c72da353c111 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.187900 Sep 07 13:35:38.102053 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 608/1252] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:37 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:39.124370 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:39.124966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.131308 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.131794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.132214 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.132899 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.133341 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.133770 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.265351 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:39.273261 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-cc380fdd-080c-4efb-ab4f-f1cba155365a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.152852 Sep 07 13:35:39.273830 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 645/1253] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:39 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:40.296759 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:40.297373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:40.303957 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.304438 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.304872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.305563 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:40.306016 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:40.306436 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:40.444859 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:40.453464 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6ac0d64a-f2d2-47f0-9b65-7841d87343c3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.160555 Sep 07 13:35:40.454044 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 609/1254] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:40 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:41.476980 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:41.477568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:41.484271 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:41.484762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:41.485201 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:41.485900 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:41.486387 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:41.486783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:41.618566 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:41.626803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d3887394-53ce-4e49-8824-36fc8ccd8409 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.154008 Sep 07 13:35:41.627399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 646/1255] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:41 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:42.649430 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:42.650066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:42.652701 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:42.653363 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell0:SELECT=6 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:42.659361 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.659851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.660288 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.660975 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.661432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.661855 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.807391 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:42.815671 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-75d041b0-e9be-4e8b-a8f2-30be059b2611 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.170277 Sep 07 13:35:42.816234 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 610/1256] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:42 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:43.837908 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:43.838526 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:43.841573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell0:SELECT=2 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:43.847008 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.847528 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.847967 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.848669 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.849125 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.849550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.984193 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.991952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f2a6921d-180b-4062-8fba-b0ab886ac45f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.157960 Sep 07 13:35:43.992521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 647/1257] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:43 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:45.015010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:45.016021 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:45.024272 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:45.024803 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:45.025281 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:45.026063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:45.026592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:45.027018 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:45.169824 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:45.180408 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-5062b2ac-011c-45ce-99f5-ba0152cc6293 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.169090 Sep 07 13:35:45.196140 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 611/1258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:45 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:46.207881 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:46.208584 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:46.214789 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.215297 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.215734 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.216422 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.216869 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.217289 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.349829 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:46.358461 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8e6f1894-8489-47e1-ae64-1ce54742ef95 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.154475 Sep 07 13:35:46.359035 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 648/1259] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:46 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:46.818732 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-465b492f-a4d4-4551-b921-1f6b99ab51ce req-aadf3a6a-a3d2-45ea-945e-25e81e2383e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29569fc-b3ba-41c6-bc21-c1f693f31a7e", "name": "network-vif-plugged", "status": "completed", "tag": "394c1d92-d558-4d59-bfb0-409b1c0168e8"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:46.829432 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-465b492f-a4d4-4551-b921-1f6b99ab51ce req-aadf3a6a-a3d2-45ea-945e-25e81e2383e2 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.829910 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-465b492f-a4d4-4551-b921-1f6b99ab51ce req-aadf3a6a-a3d2-45ea-945e-25e81e2383e2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.830337 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-465b492f-a4d4-4551-b921-1f6b99ab51ce req-aadf3a6a-a3d2-45ea-945e-25e81e2383e2 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.843125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-465b492f-a4d4-4551-b921-1f6b99ab51ce req-aadf3a6a-a3d2-45ea-945e-25e81e2383e2 service nova] Creating event network-vif-plugged:394c1d92-d558-4d59-bfb0-409b1c0168e8 for instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e on hv-cinder-80403 Sep 07 13:35:46.848034 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-465b492f-a4d4-4551-b921-1f6b99ab51ce req-aadf3a6a-a3d2-45ea-945e-25e81e2383e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105505 Sep 07 13:35:46.848710 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 612/1260] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:47.381776 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:47.382338 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:47.389416 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.389904 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.390355 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.391050 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:47.391536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:47.391962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.529934 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:47.537821 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-70b1e0ca-1c2b-4834-9d61-c4e4286e26a7 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.160079 Sep 07 13:35:47.538400 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 649/1261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:47 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:48.566959 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:48.567692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:48.573923 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.574405 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.574845 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.575576 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.576029 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.576454 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.714525 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:48.722723 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-dc50d02b-961a-436e-8b01-ccade6ebc96b tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1260 microversion: 2.1 time: 0.160598 Sep 07 13:35:48.723350 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 613/1262] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:48 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:49.745952 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:49.746554 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:49.753115 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.753601 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.754036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.754757 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.755231 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.755659 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.173732 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:50.181617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f817cad1-8e0c-4c9c-bee4-893472806d49 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1444 microversion: 2.1 time: 0.439474 Sep 07 13:35:50.182206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 650/1263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:49 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1444 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:50.203781 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:50.204399 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:50.210984 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.211507 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.211948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.212665 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.213109 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.213535 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.350938 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:50.360926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fa3ee7c2-b9e0-47f0-9a38-1477e8f62c5d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1444 microversion: 2.1 time: 0.160112 Sep 07 13:35:50.360926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 614/1264] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:50 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:52.041395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-680342c8-8792-4274-99b1-89a12ea50ff4 req-365016eb-b08b-48fd-ab82-b7a178dc98a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29569fc-b3ba-41c6-bc21-c1f693f31a7e", "tag": "394c1d92-d558-4d59-bfb0-409b1c0168e8"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:52.051666 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-680342c8-8792-4274-99b1-89a12ea50ff4 req-365016eb-b08b-48fd-ab82-b7a178dc98a0 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:52.052146 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-680342c8-8792-4274-99b1-89a12ea50ff4 req-365016eb-b08b-48fd-ab82-b7a178dc98a0 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:52.052847 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-680342c8-8792-4274-99b1-89a12ea50ff4 req-365016eb-b08b-48fd-ab82-b7a178dc98a0 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:52.063763 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-680342c8-8792-4274-99b1-89a12ea50ff4 req-365016eb-b08b-48fd-ab82-b7a178dc98a0 service nova] Creating event network-changed:394c1d92-d558-4d59-bfb0-409b1c0168e8 for instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e on hv-cinder-80403 Sep 07 13:35:52.069208 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-680342c8-8792-4274-99b1-89a12ea50ff4 req-365016eb-b08b-48fd-ab82-b7a178dc98a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031374 Sep 07 13:35:52.069976 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 651/1265] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:51.079252 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:51.080008 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=48 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:51.081239 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:37:51.081239 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: Wed Sep 7 13:37:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e/action (ip 10.222.0.61) !!! Sep 07 13:37:51.086706 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:51.087291 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:51.096653 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:51.097154 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:51.097598 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:51.098313 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:51.098771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:51.099225 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:51.125833 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lazy-loading 'flavor' on Instance uuid e29569fc-b3ba-41c6-bc21-c1f693f31a7e {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:51.200747 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-009f231c-6ee0-49c9-a6e9-6921e8f662b3 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "POST /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e/action" status: 202 len: 0 microversion: 2.1 time: 0.123289 Sep 07 13:37:51.201404 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 615/1266] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:37:51 2022] POST /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:37:51.210222 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88993e6d-e542-4c57-96b6-f20e9ab1a7f1] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 13:37:51.210798 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=22 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:51.211481 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=50 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:51.213521 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:37:51.213665 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Wed Sep 7 13:37:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e (ip 10.222.0.61) !!! Sep 07 13:37:51.215827 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:37:51.215960 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Wed Sep 7 13:37:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e (ip 10.222.0.61) !!! Sep 07 13:37:51.231854 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:51.232632 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:51.244839 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:51.245305 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:51.245737 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:51.246464 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:51.246913 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:51.247373 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:51.464824 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:51.472701 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-9851b978-74d0-4afe-a0af-abeeae0693dd tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.266541 Sep 07 13:37:51.473310 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 652/1267] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:51 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:52.501182 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:52.501880 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:52.509276 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:52.509768 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:52.510211 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:52.510928 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:52.511415 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:52.511843 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:52.721771 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:52.730497 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-fb40fbc7-4656-4b93-beae-07df1c7596b0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.234547 Sep 07 13:37:52.731089 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 616/1268] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:52 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:53.753840 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:53.754443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:53.761624 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:53.762107 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:53.762546 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:53.763285 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:53.763747 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:53.764183 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:53.770334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [-] [88993e6d-e542-4c57-96b6-f20e9ab1a7f1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36994. Sep 07 13:37:53.902407 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:53.910497 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-f96ac7d7-0440-4f5d-8fa8-f67187b67467 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.160510 Sep 07 13:37:53.911069 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 653/1269] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:53 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:54.934752 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:54.935374 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:54.942179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:54.942673 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:54.943125 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:54.943836 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:54.944367 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:54.944825 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:55.083468 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:55.093083 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-b1a3958d-ec23-4639-a5df-e2910c90c4ca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.162891 Sep 07 13:37:55.093765 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 617/1270] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:54 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:56.117199 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:56.117796 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:56.124303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:56.124787 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:56.125226 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:56.125925 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:56.126381 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:56.126812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:56.267530 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:56.275917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-e9a5a163-833c-462b-bd79-55e490a29df9 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.162839 Sep 07 13:37:56.276492 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 654/1271] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:56 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:57.301742 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:57.302347 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:57.309472 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:57.309960 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:57.310396 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:57.311097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:57.311578 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:57.312117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:57.458819 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:57.467309 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8940352b-6ee3-4642-b9d6-437eab1d77f1 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.169598 Sep 07 13:37:57.467872 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 618/1272] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:57 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:58.491513 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:58.492187 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:58.500026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:58.500026 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:58.500328 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:58.500955 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:58.501411 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:58.501836 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:58.637592 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:58.645552 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ec36c1fe-7031-4eff-8342-9f38d2e3466e tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.157843 Sep 07 13:37:58.646135 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 655/1273] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:58 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:59.669317 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:59.669948 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:59.676713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:59.677236 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:59.677677 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:59.678375 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:59.678836 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:59.679301 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:59.824168 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:59.831943 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e09db520-cb6e-4c67-b895-4fb2e4a6b50f tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.167223 Sep 07 13:37:59.832684 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 619/1274] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:59 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:00.857233 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:00.857842 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:00.864454 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:00.864943 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:00.865379 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:00.866081 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:00.866538 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:00.866966 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:01.002063 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:01.010493 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-eacfa355-15cb-47dd-849e-de41651cbb7c tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.157191 Sep 07 13:38:01.011078 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 656/1275] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:00 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:02.035464 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:02.036084 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:02.043457 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:02.043944 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:02.044379 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:02.045078 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:02.045524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:02.045941 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:02.246827 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:02.256679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-af55521c-92df-47c4-9a46-d0c002074454 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.225085 Sep 07 13:38:02.257530 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 620/1276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:02 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:03.280775 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:03.281434 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:03.288274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:03.288762 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:03.289206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:03.290536 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:03.290886 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:03.291349 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:03.434871 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:03.442891 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-12752a3e-c7ae-4b05-b122-37c8af34c880 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.166073 Sep 07 13:38:03.443542 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 657/1277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:03 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:04.469275 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:04.470117 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:04.479066 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:04.479660 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:04.480095 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:04.480805 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:04.481256 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:04.481676 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:04.686937 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:04.695970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-54979830-2098-47f0-8fa4-b11a7b08fc30 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.232907 Sep 07 13:38:04.696536 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 621/1278] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:04 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:05.736196 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:05.736827 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:05.743417 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:05.743901 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:05.744333 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:05.745064 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:05.745508 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:05.745928 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:05.888518 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:05.896398 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-8f6969ef-3ebb-45c1-af71-3c267f2fff00 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1509 microversion: 2.1 time: 0.164244 Sep 07 13:38:05.896989 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 658/1279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:05 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:05.920372 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:05.920988 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:05.927731 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:05.928228 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:05.928697 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:05.929407 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:05.929868 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:05.930315 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:05.976692 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121070) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:38:06.048811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-e5d99d20-c465-4751-be1a-d4d9b61e5b55 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "POST /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e/action" status: 202 len: 0 microversion: 2.1 time: 0.132444 Sep 07 13:38:06.049524 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 622/1280] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Sep 7 13:38:05 2022] POST /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:38:06.057740 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:06.058363 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:06.065126 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:06.065617 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:06.066059 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:06.066783 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:06.067268 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:06.067706 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:06.230334 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:06.239011 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c7187d9a-785c-4a8c-b1cf-a0bcb3f2be4a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1517 microversion: 2.1 time: 0.185120 Sep 07 13:38:06.239629 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 659/1281] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:06 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:07.262450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:07.263068 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:07.270138 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:07.270631 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:07.271072 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.271817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:07.272276 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:07.272707 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.412188 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:07.429005 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-463f0673-cad8-46a4-9e0e-b1efb9dd19ae tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1517 microversion: 2.1 time: 0.170615 Sep 07 13:38:07.429639 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 623/1282] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:07 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:07.475303 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-0249f7cc-9b7a-40fb-91fd-9cc392febe59 req-13cb22cb-2872-4f4b-b16c-a2eb835a6655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29569fc-b3ba-41c6-bc21-c1f693f31a7e", "name": "network-vif-unplugged", "status": "completed", "tag": "394c1d92-d558-4d59-bfb0-409b1c0168e8"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:07.490056 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0249f7cc-9b7a-40fb-91fd-9cc392febe59 req-13cb22cb-2872-4f4b-b16c-a2eb835a6655 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:07.490711 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0249f7cc-9b7a-40fb-91fd-9cc392febe59 req-13cb22cb-2872-4f4b-b16c-a2eb835a6655 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:07.491207 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-0249f7cc-9b7a-40fb-91fd-9cc392febe59 req-13cb22cb-2872-4f4b-b16c-a2eb835a6655 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:07.503309 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.compute.server_external_events [req-0249f7cc-9b7a-40fb-91fd-9cc392febe59 req-13cb22cb-2872-4f4b-b16c-a2eb835a6655 service nova] Unable to find a host for instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e. Dropping event network-vif-unplugged {{(pid=121069) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 13:38:07.504212 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-0249f7cc-9b7a-40fb-91fd-9cc392febe59 req-13cb22cb-2872-4f4b-b16c-a2eb835a6655 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033283 Sep 07 13:38:07.504812 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 660/1283] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 07 13:38:08.453293 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:08.453926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:08.460002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:08.460484 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:08.460926 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:08.462235 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:08.462680 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:08.463097 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:08.612919 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:08.621972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-999f1056-79bd-446a-9c07-e0eb77a2b1d0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1517 microversion: 2.1 time: 0.172932 Sep 07 13:38:08.626513 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 624/1284] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:08 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:09.645935 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:09.646543 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:09.654096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:09.654604 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:09.655047 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:09.655784 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:09.656244 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:09.656674 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:09.802854 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:09.811003 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-518580b4-01f6-476e-82e0-b7fb430ee1f4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1517 microversion: 2.1 time: 0.168913 Sep 07 13:38:09.811927 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 661/1285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:09 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:10.838748 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:10.839373 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.846921 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.847496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.847983 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.849448 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.850725 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.851222 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.999811 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:11.007735 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-0b7c992b-088a-4048-b77f-1a1a93f1b383 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1519 microversion: 2.1 time: 0.173470 Sep 07 13:38:11.008349 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 625/1286] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:10 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:12.032368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:12.032985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:12.041318 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:12.041808 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:12.042245 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:12.042955 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:12.043441 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:12.043869 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:12.235246 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:12.244111 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-180449bd-1584-4b9d-b67a-6ba5c31d1c96 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.216167 Sep 07 13:38:12.244708 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 662/1287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:12 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:13.268545 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:13.269152 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:13.275996 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.276567 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.277003 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.277691 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.278143 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.278559 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.413886 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:13.422435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-62231540-52cd-4eab-aeeb-36ea681300f5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.157845 Sep 07 13:38:13.423607 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 626/1288] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:13 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:14.445991 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:14.446596 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:14.453541 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.454028 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.454475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.455206 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.455664 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.456089 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.604803 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:14.613502 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d163a0a1-b38a-4164-ba1e-e9f77147a3e0 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.171766 Sep 07 13:38:14.614096 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 663/1289] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:14 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:15.637679 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:15.638278 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:15.644790 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:15.645277 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:15.645712 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:15.646406 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:15.646864 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:15.647334 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:15.782133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:15.790759 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-f31d42b5-5f1d-4411-b2c2-ca010a690dc5 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.157006 Sep 07 13:38:15.791386 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 627/1290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:15 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:16.814143 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:16.814758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:16.821794 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.822280 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.822754 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.823618 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.823962 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.824408 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.972557 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:16.984758 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-d28c1a5a-ebfc-45f5-8eb2-60dd3c28314a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.174509 Sep 07 13:38:16.985350 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 664/1291] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:16 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:18.008901 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:18.009493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:18.019127 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.019913 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.020495 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.021292 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.021751 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.022231 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.044856 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:18.165667 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:18.173606 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-61413a9a-f694-4304-9326-398644af1062 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.169127 Sep 07 13:38:18.174186 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 628/1292] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:18 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:19.197281 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:19.197917 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:19.204476 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.204968 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.205408 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:19.206112 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.206568 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.207001 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:19.343657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:19.352395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ce99a8b4-aca9-4b49-9562-61580a8eff98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.159551 Sep 07 13:38:19.352970 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 665/1293] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:19 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:20.375935 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:20.376894 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:20.383322 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.383816 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.384258 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.384967 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.385417 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.385841 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.541486 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:20.551808 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-99a7b9a5-413f-43aa-ac57-b780f7650728 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.179659 Sep 07 13:38:20.552392 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 629/1294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:20 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:21.576714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:21.577444 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:21.581176 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=29 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:21.585376 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.585873 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.586312 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.587027 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.587520 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.587953 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.591335 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=81 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:21.738344 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:21.747036 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-ea06b929-a1ce-49cf-ad5f-56668a6022e4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.174800 Sep 07 13:38:21.747665 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 666/1295] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:21 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:22.770822 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:22.771496 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:22.774450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:22.781388 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.781891 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.782336 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.783061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.783562 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.783979 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.935222 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:22.943837 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-6e22654e-d64a-493b-b189-45ef680ce96a tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.176877 Sep 07 13:38:22.944592 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 630/1296] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:22 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:23.576742 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29569fc-b3ba-41c6-bc21-c1f693f31a7e", "name": "network-vif-plugged", "status": "completed", "tag": "394c1d92-d558-4d59-bfb0-409b1c0168e8"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:23.588850 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:23.589354 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:23.589774 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:23.608516 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] Creating event network-vif-plugged:394c1d92-d558-4d59-bfb0-409b1c0168e8 for instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e on hv-cinder-80403 Sep 07 13:38:23.614460 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR oslo.messaging._drivers.impl_rabbit [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] [42a542c4-dfb1-4c28-b1fb-de58788a94bc] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:38:23.970445 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:23.971520 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:23.982483 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:23.983063 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:23.983526 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:23.984239 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:23.984695 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:23.985119 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:24.135519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:24.143714 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-091d2ce6-ee8d-46e4-a36e-e1ee7569a915 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.178950 Sep 07 13:38:24.144296 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 631/1297] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:23 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:24.623714 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO oslo.messaging._drivers.impl_rabbit [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] [42a542c4-dfb1-4c28-b1fb-de58788a94bc] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37090. Sep 07 13:38:24.629399 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-63b7ccef-b4ac-4708-8a13-6dda860dcf18 req-3276c2de-31aa-4d28-b369-20a44a8997fb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.056257 Sep 07 13:38:24.630323 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 667/1298] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:25.167380 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:25.168061 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:25.176435 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:25.177035 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:25.177582 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:25.178401 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:25.178972 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:25.179616 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:25.338930 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:25.347010 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-21d8a702-3ea4-4b54-aad3-9a485837cf19 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.184274 Sep 07 13:38:25.347626 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 632/1299] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:25 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:26.376509 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:26.377658 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:26.388076 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:26.388892 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:26.389610 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:26.390782 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:26.391561 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:26.392263 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:26.552475 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:26.566583 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-895065a5-1b34-4c80-a3cb-c2e2e34d6bbc tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1575 microversion: 2.1 time: 0.195708 Sep 07 13:38:26.567699 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 668/1300] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:26 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:27.592541 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:27.593767 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:27.602054 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:27.602619 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:27.603209 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:27.604056 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:27.604693 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:27.605212 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:27.767002 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:27.777633 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-99f2798f-2f0e-4417-b3d4-ebc6616e8aca tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1562 microversion: 2.1 time: 0.191071 Sep 07 13:38:27.778493 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 633/1301] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:27 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:50.527573 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_api:SELECT=5 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:50.528347 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG dbcounter [-] [121069] Writing DB stats nova_cell1:SELECT=13 {{(pid=121069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:50.533197 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:50.533700 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:50.537914 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_api:SELECT=7 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:50.538649 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG dbcounter [-] [121070] Writing DB stats nova_cell1:SELECT=32 {{(pid=121070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:50.553485 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.553985 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.554452 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.555325 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.555793 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.556226 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.586808 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Going to try to terminate instance {{(pid=121069) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:39:50.606970 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [req-4b0c7855-4ccb-449d-bc7e-d95e15a6e71f req-2ab60ed4-26b1-4e64-8c90-029cc27bed71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29569fc-b3ba-41c6-bc21-c1f693f31a7e", "tag": "394c1d92-d558-4d59-bfb0-409b1c0168e8"}]} {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:50.616437 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-4b0c7855-4ccb-449d-bc7e-d95e15a6e71f req-2ab60ed4-26b1-4e64-8c90-029cc27bed71 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.616911 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-4b0c7855-4ccb-449d-bc7e-d95e15a6e71f req-2ab60ed4-26b1-4e64-8c90-029cc27bed71 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.617338 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [req-4b0c7855-4ccb-449d-bc7e-d95e15a6e71f req-2ab60ed4-26b1-4e64-8c90-029cc27bed71 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.628887 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.compute.server_external_events [req-4b0c7855-4ccb-449d-bc7e-d95e15a6e71f req-2ab60ed4-26b1-4e64-8c90-029cc27bed71 service nova] Creating event network-changed:394c1d92-d558-4d59-bfb0-409b1c0168e8 for instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e on hv-cinder-80403 Sep 07 13:39:50.634133 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [req-4b0c7855-4ccb-449d-bc7e-d95e15a6e71f req-2ab60ed4-26b1-4e64-8c90-029cc27bed71 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097689 Sep 07 13:39:50.634744 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 634/1302] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:50.671294 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2a410365-560c-4877-840e-7273f7303e98 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 204 len: 0 microversion: 2.1 time: 0.145365 Sep 07 13:39:50.671893 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 669/1303] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Sep 7 13:39:50 2022] DELETE /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:39:50.680793 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:50.681699 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:50.688423 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.689806 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.690519 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.691713 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.692179 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.692599 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.840625 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:50.850104 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-99b75c28-b832-41a9-ad3f-8b0674d74fc2 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.173639 Sep 07 13:39:50.850681 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 635/1304] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:50 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:51.874586 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:51.875296 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:51.881941 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.882410 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.882848 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:51.883550 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.883992 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.884409 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:52.019692 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.policy [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121069) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:52.028808 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-2d39f4df-e398-48a8-b00f-a4cee4d183da tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1568 microversion: 2.1 time: 0.158356 Sep 07 13:39:52.029402 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 670/1305] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:51 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:53.053739 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:53.054442 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:53.060931 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.061418 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.061846 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.062540 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.062985 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.063450 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.130788 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:53.139746 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-90f03111-197c-417f-89a4-890d6a3456c4 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1382 microversion: 2.1 time: 0.089805 Sep 07 13:39:53.140552 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 636/1306] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:53 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:53.190529 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [req-f0f8f561-d85f-4462-9f57-5cf63d29cc5f req-32d36a6b-f5f7-4b9d-a621-7103a9a778b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29569fc-b3ba-41c6-bc21-c1f693f31a7e", "name": "network-vif-deleted", "tag": "394c1d92-d558-4d59-bfb0-409b1c0168e8"}]} {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:53.201274 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-f0f8f561-d85f-4462-9f57-5cf63d29cc5f req-32d36a6b-f5f7-4b9d-a621-7103a9a778b1 service nova] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.201657 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-f0f8f561-d85f-4462-9f57-5cf63d29cc5f req-32d36a6b-f5f7-4b9d-a621-7103a9a778b1 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.202101 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [req-f0f8f561-d85f-4462-9f57-5cf63d29cc5f req-32d36a6b-f5f7-4b9d-a621-7103a9a778b1 service nova] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.214040 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.compute.server_external_events [req-f0f8f561-d85f-4462-9f57-5cf63d29cc5f req-32d36a6b-f5f7-4b9d-a621-7103a9a778b1 service nova] Creating event network-vif-deleted:394c1d92-d558-4d59-bfb0-409b1c0168e8 for instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e on hv-cinder-80403 Sep 07 13:39:53.218904 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [req-f0f8f561-d85f-4462-9f57-5cf63d29cc5f req-32d36a6b-f5f7-4b9d-a621-7103a9a778b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032027 Sep 07 13:39:53.219532 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 671/1307] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:54.163279 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:54.164046 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.compute.api [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121070) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:54.170905 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.171506 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.171933 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.172627 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.173074 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.173498 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.207460 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.207945 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.208390 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG oslo_concurrency.lockutils [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.208817 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.objects.instance [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lazy-loading 'fault' on Instance uuid e29569fc-b3ba-41c6-bc21-c1f693f31a7e {{(pid=121070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:39:54.256052 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.policy [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923df66d00e04d73aab0a82bc671cb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fd5ac76e47431eb9ed60b34784d2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121070) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:54.264266 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-8b28a916-d9ee-46a3-a3f5-a785066cbdad tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 200 len: 1224 microversion: 2.1 time: 0.104804 Sep 07 13:39:54.264851 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 637/1308] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:54 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:55.292443 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '>' {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:55.293145 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.compute.api [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] [instance: e29569fc-b3ba-41c6-bc21-c1f693f31a7e] Fetching instance by UUID {{(pid=121069) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:55.299697 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:55.300197 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:55.300638 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:55.301368 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Acquiring lock "03b1f7e0-85a9-4e40-963d-59c98178354b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:55.301822 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:55.302250 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG oslo_concurrency.lockutils [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Lock "03b1f7e0-85a9-4e40-963d-59c98178354b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:55.316283 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.wsgi [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] HTTP exception thrown: Instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e could not be found. Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Request method failure captured: Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: request: GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e HTTP/1.1 Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept: application/json Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Accept-Encoding: identity Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Connection: close Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Length: 0 Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Content-Type: application/json Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Host: 10.222.0.61 Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: Openstack-System-Scope: None Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: User-Agent: python-urllib3/1.26.12 Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Auth-Token: gAAAAABjGJ4KKc8GoUeabRKa5w3cW56_o5Bi6e7dWj2xxkQfp-yNkSw4Lp2mVKrpAmWozcuvJgN398zZ-zl_5IR0qxT6hB0UfqNER2z2lHay-MvuMG6x1PMfRGdIRw49js42gAJse_uofufejS2HCPAXB9F4Ok6JmQ9ARBOr4Zt9711hriiZ7r0 Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Id: None Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Domain-Name: None Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Identity-Status: Confirmed Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Is-Admin-Project: True Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Id: default Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Domain-Name: Default Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Id: e4fd5ac76e47431eb9ed60b34784d2e3 Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Project-Name: tempest-TestShelveInstance-532656237 Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Role: reader,member Sep 07 13:39:55.317930 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Roles: reader,member Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e4fd5ac76e47431eb9ed60b34784d2e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4fd5ac76e47431eb9ed60b34784d2e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4fd5ac76e47431eb9ed60b34784d2e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e4fd5ac76e47431eb9ed60b34784d2e3"}]}] Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant: tempest-TestShelveInstance-532656237 Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Id: e4fd5ac76e47431eb9ed60b34784d2e3 Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-Tenant-Name: tempest-TestShelveInstance-532656237 Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User: tempest-TestShelveInstance-532656237-project Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Id: default Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Domain-Name: Default Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Id: 923df66d00e04d73aab0a82bc671cb13 Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: X-User-Name: tempest-TestShelveInstance-532656237-project Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: method: > Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: exception: Instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e could not be found. Sep 07 13:39:55.319815 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: action_args: {'id': 'e29569fc-b3ba-41c6-bc21-c1f693f31a7e'} Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: {{(pid=121069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e could not be found. Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:39:55.321655 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e could not be found. Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e could not be found. Sep 07 13:39:55.323395 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: ERROR nova.api.openstack.wsgi Sep 07 13:39:55.325141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: DEBUG nova.api.openstack.wsgi [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Returning 404 to user: Instance e29569fc-b3ba-41c6-bc21-c1f693f31a7e could not be found. {{(pid=121069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:39:55.325141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: INFO nova.api.openstack.requestlog [None req-c9d4e6dc-5bc4-4892-b008-14b9ae56814d tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e" status: 404 len: 111 microversion: 2.1 time: 0.034901 Sep 07 13:39:55.325141 dv-cinder-804035-50-iscsi devstack@n-api.service[121069]: [pid: 121069|app: 0|req: 672/1309] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:55 2022] GET /compute/v2.1/servers/e29569fc-b3ba-41c6-bc21-c1f693f31a7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:39:55.486542 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: DEBUG nova.api.openstack.wsgi [None req-18226765-4c25-485c-850f-19f26170c070 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] Calling method '.version_select at 0x7fa3db952670>' {{(pid=121070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:55.515012 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: INFO nova.api.openstack.requestlog [None req-18226765-4c25-485c-850f-19f26170c070 tempest-TestShelveInstance-532656237 tempest-TestShelveInstance-532656237-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-280276680" status: 202 len: 0 microversion: 2.1 time: 0.032291 Sep 07 13:39:55.515950 dv-cinder-804035-50-iscsi devstack@n-api.service[121070]: [pid: 121070|app: 0|req: 638/1310] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Sep 7 13:39:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-280276680 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)